[S-CG50] Driving Solid Earth Science through Machine Learning

[SCG50-P02] Surrogate modeling of hydrothermal systems utilizing the framework of continual learning

*Kazuya Ishitsuka¹ (1.Kyoto University)

Keywords:Deep learning, Surrogate modeling, Hydrothermal system

Recent advances in deep learning allow for utilizing neural networks for the surrogate modeling of subsurface systems. Thanks to the universal approximation capability of deep learning, the trained network can be used to simulate physical phenomena with less computational cost. In this study, I developed a framework of the surrogate modeling of hydrothermal systems using continual learning. Modeling hydrothermal systems is important to understand the nature of subsurface hydrothermal fluid migration, whereas one of the difficulties of the modeling is lack of observation data. To mitigate the problem, the use of transfer learning framework may be a practical option. However, transfer learning has a problem of catastrophic forgetting, which is a phenomenon in which when a deep neural network is trained with new information that is relevant in turn, the prediction accuracy with respect to previously learned information drops drastically. The framework of continual learning is potentially effective for the problem because the algorithm has strategies to mitigate catastrophic forgetting.
I examined the developed framework with 2D synthetic models. Three-types of synthetic hydrothermal conceptual models were firstly created, and 2000 numerical datasets were then generated for each conceptual model. A deep fully-connected neural network was trained with the numerical datasets based on different conceptual models in sequence, and the accuracy of predicted quantities were examined. As a result, while the transfer learning framework failed to maintain the prediction accuracy once another type of datasets was trained, the developed framework with continual learning successfully maintained the prediction accuracy related to previously trained types of datasets.