Japan Geoscience Union Meeting 2015

Presentation information

Poster

Symbol M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI37] Earth and planetary informatics with huge data management

Wed. May 27, 2015 6:15 PM - 7:30 PM Convention Hall (2F)

Convener:*Eizi TOYODA(Numerical Prediction Division, Japan Meteorological Agency), Mayumi Wakabayashi(Kiso-Jiban Consultants Co.,Ltd), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Eizi TOYODA(Numerical Prediction Division, Japan Meteorological Agency), Ken T. Murata(National Institute of Information and Communications Technology), Junya Terazono(The University of Aizu), Tomoaki Hori(Nagoya University Solar Terrestrial Environment Laboratory Geospace Research Center), Kazuo Ohtake(Japan Meteorological Agency), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University)

6:15 PM - 7:30 PM

[MGI37-P03] Migration to BUFR/CREX of meteorological observation reports

*Eizi TOYODA1 (1.Numerical Prediction Division, Japan Meteorological Agency)

Keywords:WMO, World Weather Watch Programme, Upper-air obsservation, Table-driven code form, BUFR, TEMP

The World Meteorological Organization (WMO) is tring to finalize its decades-long migration plan of the format of conventional observation reports, from telgram-based traditional alphanumeric codes (TAC) to the table-driven code forms (TDCF). For major types of observatios, the deadline of migration was November 2014, and several countries terminated dissemination of reports in TAC.

There are two forms of TDCF: the preferred form is binary called BUFR, while an alternative one called CREX can be used for single-case character-based telecommunication channel. In both forms, the message contains a list of 16-bit numbers called element descriptors defines the structure of following data. Each element descriptor represents either a number (with units), an ASCII character string, an enumeration or a flag field (referring to external table). The descriptor list may include (maybe nested) repetition, and that allows XML-like semi-structured data such as list of a structure associated with other type of data.

With respect to self-descriptivity, the benefit of a TDCF message is that a new data structure can be analyzed without documentation, while the self-description is completed only after referring to external tables. Some features are considered old-fashoned (in comparison to XML), such as being binary, number-based, referring to external tables. Sometimes it is explained that the telecommunication bandwidth was much more expensive at the early stage of TDCF development in 1990s, and the short size had to be pursued at the sacrifice of readability. But the features have benefit of reducing freedom of representation, which is important for stability of operational system.

The migration to TDCF is almost perfect for satellite data, while it takes many yeares for surface-based observation, since all WMO members have to change their own systems. Use of upper-air sounding in TCDF requires great effort and care; firstly the TDCF was planned to have more elements and precision, while many countries circulate reformatted TAC with compromised content.