JpGU-AGU Joint Meeting 2020

Presentation information

[J] Poster

M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI41] Earth and planetary informatics with huge data management

convener:Ken T. Murata(National Institute of Information and Communications Technology), Rie Honda(Department of Science and Technology, System of Natual Science, Kochi University), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University)

[MGI41-P03] HpFP: development of high-speed data transfer applications (1)

Yasunori Kakizawa1, Ayahiro Takaki1, *Takamichi Mizuhara1, Yuya Kagebayashi1, Praphan Pavarangkoon3, Kazuya Muranaga2, Kazunori Yamamoto3, Ken T. Murata3 (1.CLEALINK TECHNOLOGY CO., LTD., 2.SEC CO., LTD., 3. National Institute of Information and Communications Technology)

Keywords:LFN, SINET, High-performance network

For LFNs (Long-Fat Networks) with 10 Gbps or more and satellite networks with large latency, a variety of TCP-based protocols have been proposed which show high performance on large latency network conditions. However, such TCP protocols are essentially unable to archive large bandwidth on high latency networks accompanied with packet-losses that are inevitable on practical LFNs or satellite networks. To overcome this issue, we designed a new data transfer protocol on TCP/IP transport layer built on top of UDP: High-performance and Flexible Protocol (HpFP). It constantly monitors latency (RTT) and packet losses, and conducts rate control and retransmission control based on them to enable higher bandwidth data transfer than 10 Gbps even on packet-loss conditions over LFNs. The basic concepts are addressed and protocol design of the HpFP are discussed. An applications to transfer many data files in small size (e.g., 1MB x 10000 files) with almost wire-rate bandwidth (10 Gbps) is also addressed. In this study we develop a tool to bind multiple connection of HpFP aiming at higher throughput on a broadband network faster than 100Gbps. In the near future, big data transfer with high speed is expected on LFNs such as SINET5.