JpGU-AGU Joint Meeting 2020

Presentation information

Print

[J] Poster

M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI41] Earth and planetary informatics with huge data management

convener:Ken T. Murata(National Institute of Information and Communications Technology), Rie Honda(Department of Science and Technology, System of Natual Science, Kochi University), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University)

[MGI41-P02] An Initial Report of StarBED for HpFP Development

*Praphan Pavarangkoon1, Ken T. Murata1, Tsubasa Yumura1, Kazunori Yamamoto1, Takamichi Mizuhara2, Yuya Kagebayashi2, Yasunori Kakizawa2, Kazuya Muranaga3 (1.National Institute of Information and Communications Technology, Tokyo, Japan, 2.CLEALINK TECHNOLOGY Co., Ltd., Kyoto, Japan, 3.Systems Engineering Consultants Co., Ltd., Tokyo, Japan)

Keywords:HpFP, Data Transfer, Earth Observation, Real-Time Monitoring

With the rapid development of big data and cloud computing technologies, Earth observation (EO) data generated by satellites and sensors are transferred to remote cloud data centers for analysis and storage. Real-time monitoring and tracking applications such as disaster management, military, agriculture, etc. utilize these EO data and play an important role in human life. However, it is hard to handle a large and growing amount of these EO data, and to achieve them in real time. We develop a novel transport protocol, named high-performance and flexible protocol (HpFP), to enhance the efficiency of data transfer of the EO data. The HpFP is designed on the top of user datagram protocol (UDP), but is a connection-oriented and reliable stream-type protocol. The original HpFP is designed first for specified networks and puts more emphasis on latency and packet loss tolerances than fairness and friendliness, while the HpFP2 is more suitable for real network environments. To accommodate different usage scenarios, we complete four operating modes of HpFP2: aggressive, fair, fast-start, and modest modes. StarBED is constructed and operated by National Institute of Information and Communications Technology (NICT), Japan as a large-scale, general-purpose Internet simulator connected by network switches to the 728 servers (nodes). In this research, we present an initial report of StarBED for HpFP development. We conduct to evaluate our HpFP2 under real-time situations with several QoS requirements using the StarBED. The details of setup and usage of the StarBED for HpFP development are presented. In addition, the experiment results are also presented and discussed.