[M-GI30] Earth and planetary informatics with huge data management

[MGI30-P06] HpFP: development of high-speed data transfer applications (5): A high-performance data transfer on satellite network using Starlink satellite

*Takamichi Mizuhara¹, Yasunori Kakizawa¹, Ayahiro Takaki¹, Keiichiro Fukazawa², Kazuya Muranaga⁴, Kazunori Yamamoto³, Tomohiro Kawanabe³, Ken T. Murata³ (1.CLEALINK TECHNOLOGY CO., LTD., 2.Kyoto University, 3.National Institute of Information and Communications Technology, 4.Systems Engineering Consultants Co.,LTD. )

Keywords:HpFP, HCP, High-speed data transfer, network protocol

For LFNs (Long-Fat Networks) with 10 Gbps or more and satellite networks with large latency, a variety of TCP-based protocols have been proposed which show high performance on large latency network conditions. However, such TCP protocols are essentially unable to archive large bandwidth on high latency networks accompanied with packet-losses that are inevitable on practical LFNs or satellite networks. To overcome this issue, we designed a new data transfer protocol on TCP/IP transport layer built on top of UDP: High-performance and Flexible Protocol (HpFP). It constantly monitors latency (RTT) and packet losses and conducts rate control and retransmission control based on them to enable higher bandwidth data transfer than 10 Gbps even on packet-loss conditions over LFNs. The basic concepts are addressed and protocol design of the HpFP are discussed. An application (named as Archaea tools) to transfer many data files in small size (e.g., 1MB x 10000 files) with almost wire-rate bandwidth (10 Gbps) is also addressed. In this study we develop a tool to bind multiple connection of HpFP aiming at higher throughput on a broadband network faster than 100Gbps. In the near future big data transfer with high speed is expected on LFNs such as SINET5.
In this presentation, we present the results of a high-speed data transmission experiment conducted by Clairlink Technology, National Institute of Information and Communications Technology, and Kyoto University Academic Information and Media Center at the DMC (Data Mover Challenge) 2023, a contest at the SC Asia conference held in 2024. In addition to the existing 100G backbone network, DMC2023 added satellite communication performance evaluation using Starlink satellite to the measurement regulations. In this presentation, we specifically report on high-speed data transmission performance in the satellite communication network.
This work is supported by "Joint Usage/Research Center for Interdisciplinary Large-scale Information Infrastructures" and "High Performance Computing Infrastructure" in Japan (Project ID: jh230057), by JSPS KAKENHI Grant Number JP22H01318 and by Council for Science, Technology and Innovation (CSTI), Cross-ministerial Strategic Innovation Promotion Program (SIP), Development of a Resilient Smart Network System against Natural Disasters (Funding agency: NIED).