JpGU-AGU Joint Meeting 2020

Presentation information

[J] Poster

M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI41] Earth and planetary informatics with huge data management

convener:Ken T. Murata(National Institute of Information and Communications Technology), Rie Honda(Department of Science and Technology, System of Natual Science, Kochi University), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University)

[MGI41-P01] Himawari Data Transfer to Asian Countries

*Praphan Pavarangkoon1, Ken T. Murata1, Kazunori Yamamoto1, Atsushi Higuchi2, Takamichi Mizuhara3, Yuya Kagebayashi3, Ayahiro Takaki3, Kazuya Muranaga4, Chalermpol Charnsripinyo5, Bayani Benjamin R. Lara6, Joel Joseph S. Marciano, Jr.6, Eric Yen7, Simon C. Lin7, Keiichiro Fukazawa8 (1.National Institute of Information and Communications Technology, Japan, 2.Center for Environmental Remote Sensing, Chiba University, Japan, 3.CLEALINK TECHNOLOGY Co., Ltd., Japan, 4.Systems Engineering Consultants Co., Ltd., Japan, 5.National Electronic and Computer Technology Center, Thailand, 6.Advanced Science and Technology Institute, Department of Science and Technology, Philippines, 7.Academia Sinica Grid Computing Centre, Taiwan, 8.Academic Center for Computing and Media Studies, Kyoto University, Japan)

Keywords:Himawari, Earth Observation, Data Transfer, HpFP

Quick dissemination of weather information to Asian countries in the risk region is of great significance from the viewpoint of weather disaster mitigation. Geostationary meteorological satellites play an important role to provide continuous atmospheric observations both for weather forecasting and for monitoring a wide range of environmental phenomena. The third-generation geostationary meteorological satellites equipped with highly improved imagers, e.g., Himawari-8/9 provide a huge amount of Earth observation data. In this research, we propose a high-speed data transmission system using a file transfer tool, called high-performance copy (HCP). The HCP is high-performance and flexible protocol 2 (HpFP2)-based and is a server-client command line tool, which works on several operating systems (OSs) such as Linux and Windows. It can push files to another server or pull files from another server. With the advantages of the HpFP2, the HCP is able to transfer files effectively under networks with high latency and packet loss, e.g., international networks. In addition, the HCP is a great way to synchronize files that a user can maintain on more than one system. In the proposed high-speed data transmission system, a set of tiled pyramid image files is generated every 10 minutes on the Himawari-8 real-time web in Japan, and then transferred to the mirror websites in Thailand, Philippines, and Taiwan. Moreover, we have a plan to provide the archive data to Asian countries in the near future. The results show that our system is effective and appropriate for real use. This suggests that the proposed high-speed data transmission system has a potential for deployment in other Asian countries.