[2G4-OS-21d] 世界モデルと知能

[2G4-OS-21d-04] A World Model for Learning Policies Utilizing Prior Knowledge in Similar Graph Environments

〇Kazuki Kawamura¹, Hayato Ikenochi³, Shunya Ishikawa², Ayana Murakami⁴, Makoto Kawano¹, Yutaka Matsuo¹ (1. The University of Tokyo, 2. The University of Electro-Communications, 3. Ehime University, 4. Ochanomizu University)

Keywords:World Models, Deep Learning, Reinforcement Learning, Graph Neural Network, Game AI

In this paper, we introduce a reinforcement learning method based on a world model that finds the optimal policy in an environment represented by a graph. There are many environments in virtual and real worlds that are represented by graphs, such as games, transportation networks, knowledge graphs, social networks, and communication networks. Although there are several methods for finding the optimal policy in these environments, existing research has not been able to utilize prior knowledge from similar environments when learning new policies. Therefore, in this study, we propose a method for learning better policies in environments represented by graphs when knowledge of the environment is acquired. We also show that the proposed method outperforms a simple search method without prior knowledge by simulating a maze game represented by a graph.