Japan Geoscience Union Meeting 2014

Presentation information

Print

Oral

Symbol S (Solid Earth Sciences) » S-TT Technology & Techniques

[S-TT60_30PM2] Creating future of solid Earth science with high performance computing (HPC)

Wed. Apr 30, 2014 4:15 PM - 5:00 PM 211 (2F)

Convener:*Ryota Hino(International Research Institute of Disaster Science, Tohoku University), Yoshimori Honkura(Volcanic Fluid Research Center, Tokyo Institute of Technology), Yoshiyuki Kaneda(Japan Agency for Marine-Earth Science and Technology), Taro Arikawa(Port and Airport Research Institute), Tsuyoshi Ichimura(Earthquake Research Institute,The University of Tokyo), Masaru Todoriki(Center for Integrated Disaster Information Research / Earthquake Research Institute, The University of Tokyo), Takane Hori(Earthquake and Tsunami Research Project for Disaster Prevention, Japan Agency for Marine-Earth Science and Technology), Chair:Hiromichi Nagao(Earthquake Research Institute, The University of Tokyo)

4:30 PM - 4:45 PM

[STT60-09] Techniques of Big-Data Processing on the NICT Science Cloud

*Ken T. MURATA1, Hidenobu WATANABE1, Kentaro UKAWA2, Kazuya MURANAGA2, Suzuki YUTAKA2, Osamu TATEBE3, Masahiro TANAKA3, Eizen KIMURA4 (1.NICT, 2.Systems Engineering Consultants Co., LTD., 3.University of Tsukuba, 4.Ehime University)

This paper is to propose a cloud system for science, which has been developed at NICT (National Institute of Information and Communications Technology), Japan. The NICT science cloud is an open cloud system for scientists who are going to carry out their informatics studies for their own science. The NICT science cloud is not for simple uses. Many functions are expected to the science cloud; such as data standardization, data collection and crawling, large and distributed data storage system, security and reliability, database and meta-database, data stewardship, long-term data preservation, data rescue and preservation, data mining, parallel processing, data publication and provision, semantic web, 3D and 4D visualization, out-reach and in-reach, and capacity buildings.In the present study, we examine performance of parallelization of I/O on the NICT Science Cloud system. We examine an I/O performance of data file system; distributed file system (Gfarm). The Gfarm file system shows a tremendous fast I/O, as fast as 23 GB/sec using only 30 servers. We should pay attention to this I/O speed (23GB/sec is 184 Gbps) from the viewpoint of network speed. We also discuss that the distributed file system shows high scalability: Parallelization efficiency in the present examination is higher than 90% in case of parallel file system. We finally discuss high-performance data processing on the NICT Science Cloud. We have already archived several examples using our technique for both Earth and Space observation data and simulation data. The speed up of the data processing is more than 60 times for scientific big-data.