Japan Geoscience Union Meeting 2016

Presentation information


Symbol M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI21] Earth and planetary informatics with huge data management

Tue. May 24, 2016 5:15 PM - 6:30 PM Poster Hall (International Exhibition Hall HALL6)

Convener:*Ken T. Murata(National Institute of Information and Communications Technology), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Tomoaki Hori(Institute for Space-Earth Environmental Research, Nagoya University), Eizi TOYODA(Forecast Department, Japan Meteorological Agency), Junya Terazono(The University of Aizu), Mayumi Wakabayashi(Kiso-Jiban Consultants Co.,Ltd), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University), Kazuo Ohtake(Japan Meteorological Agency)

5:15 PM - 6:30 PM

[MGI21-P10] A high-bandwidth virtual remote storage (HbVRS) system on long fat network (LFN) and its application

*Kazunori Yamamoto1, Ken T. Murata1, Yoshiaki Nagaya1, Kazuya Muranaga2, Takamichi Mizuhara3, Osamu Tatebe4, Masahiro Tanaka4, Eizen Kimura5, Takashi Kurosawa6 (1.National Institute of Information and Communications Technology, 2.Systems Engineering Consultants Co., LTD., 3.CLEALINKTECHNOLOGY Co.,Ltd., 4.University of Tsukuba, 5.Department of Medical Informatics Ehime Univ., 6.Hitachi Solutions East Japan, Ltd.)

Science cloud is a cloud system specialized for data intensive/centric science, which is based on a concept of the fourth paradigm proposed by Jim Gray in 2009. However, only a few science cloud systems have ever yielded tremendous scientific results so far. High-bandwidth storage I/O is one of the important issues to be overcome for big data sciences. In the study, we propose a high-bandwidth virtual remote storage (HbVRS) tool using a distributed file system (Gfarm) and a UDP-based data transfer protocol (HpFP). The tool is based on our examination of parallel HpFP data transfer in 10 Gbps using a long-distance 10G network (long fat network: LFN) between Japan and USA crossing the Pacific. We installed an application to draw a set of time sequential graphic files using the tool on the NICT Science Cloud. We successfully read data files in order of time sequence from a virtual storage as fast as more than 20 Gbps. The present results suggest that client hosts connected with a long fat network will be able to access to big data stored in cloud storage wherever over the world it is located. An application is demonstrated using the HbVRS.