Japan Geoscience Union Meeting 2019

Presentation information

[J] Poster

M (Multidisciplinary and Interdisciplinary) » M-GI General Geosciences, Information Geosciences & Simulations

[M-GI37] Earth and planetary informatics with huge data management

Sun. May 26, 2019 5:15 PM - 6:30 PM Poster Hall (International Exhibition Hall8, Makuhari Messe)

convener:Ken T. Murata(National Institute of Information and Communications Technology), Rie Honda(Department of Science and Technology, System of Natual Science, Kochi University), Susumu Nonogaki(Geological Survey of Japan, National Institute of Advanced Industrial Science and Technology), Takeshi Horinouchi(Faculty of Environmental Earth Science, Hokkaido University)

[MGI37-P15] Performance evaluation of inter-node MPI parallel TensorFlow for massive learning data

*Keiichiro Fukazawa1 (1.Academic Center for Computing and Media Studies, Kyoto University)

Keywords:machine learning, inter-node parallel

Recently machine learning (ML) achieves great works in the recognition, and it plays an essential role in the AI (artificial intelligence) area. In general, the learning data is one of the most critical keys for the ML since the feature extraction from each learning data affects strongly to the accuracy of recognition. Thus, the large amount of learning data is required for ML to avoid bias recognition. However, it takes a long time and needs many computer memory to learn from the massive data. In this talk, the inter-node MPI parallel TensorFlow is introduced.

TensorFlow is the one of ML framework developed by Google, and it is used in the world. Google has developed the inter-node parallel TensorFlow however it is not suitable for the supercomputer such as picking up the local computing node directly to participate in the calculation. To overcome this problem, Horovod MPI based TensorFlow has released by Uber, and it can use the MPI tuned for the supercomputer. As the collaboration of Cray and Kyoto University, more optimized MPI based TensorFlow which is called as CPE ML Plugin has been introduced to the supercomputer of Kyoto University. In this talk the performance evaluation of this MPI based TensorFlow.