[M-GI35] Earth and planetary informatics with huge data management

[MGI35-P13] Combination of HPC and high-speed data transfer technologies for big-data processing systems (2)

*Kazunori Yamamoto¹, Ken T. Murata¹, Kazuya Muranaga², Yasunori Kakizawa³, Takamichi Mizuhara³, Ayahiro Takaki³, Keiichiro Fukazawa⁴, Yoshitaka Ohyoshi⁵ (1.National Institute of Information and Communications Technology, 2.Systems Engineering Consultants Co.,LTD., 3.CLEALINK TECHNOLOGY Co., Ltd., 4.Academic Center for Computing and Media Studies, Kyoto University, 5.Virtual Corp.)

Keywords:HpFp, 10Gpbs, JHPCN

NICT, National Institute of Information and Communications Technology, and Kyoto University have been developing and examining large-scale data transfer technology (HpFP) and high-speed communication technology (HpVT) in association with Clearlink Technology Co., Ltd. Since 2018, we have been conducting a wide-area system to verify out techniques using actual data in the Joint Usage/Research Center for Interdisciplinary Large-scale Information Infrastructures. Each base university (Tohoku University, Tokyo University, Nagoya University, Kyoto University, Kyushu University) and research bases (Tohoku University, Tokyo University, Nagoya University, Kyoto University, Kyushu University) is connected via JGN and SINET, high-speed backbone networks, using the highly functional communication protocol HpFP. By 2021 we have built an L2VPN network service (named as “JHPCN wide area distributed cloud”) that transfers and shares data at high speed between the information infrastructure centers of Chiba University, Kyoto0 University, Kyushu University, and NICT. Furthermore, we verified the performance of this environment and confirmed that the data transmission speed between bases can be achieved at or occasionally higher than that of a general LAN environment. As a result, researchers can freely utilize the huge computer resources provided by each research base; it has become possible to realize unprecedented big data science.