Presentation information

General Session

General Session » GS-5 Agents

[2O5-GS-5] Agents: game AI

Wed. Jun 15, 2022 3:20 PM - 5:00 PM Room O (Room 510)

座長:沖本 天太(神戸大学)[遠隔]

3:40 PM - 4:00 PM

[2O5-GS-5-02] Agent Reinforcement Learning by Using a Finite State Machine with Deep Neural Network

〇Jitao Zhou1, Youichiro Miyake1 (1. Rikkyo University Graduate School)

Keywords:Reinforcement Learning, Finite State Machine, Deep Learning, Character Control, Game AI

An agent design by using reinforcement learning has been made progress, and there is a need for more efficient and flexible methods to control reinforcement learning. Therefore, the combination of classical decision-making model, the state machine, and deep neural network (DNN) reinforcement learning is supposed and examined. A state with DNN, in which one trained deep neural network (DNN) is installed per state, and a neural net is switched by state transition to control the movement of character. A state is a set of symbolistically defined state and connectionism NN. It makes character AI creation more flexible. In this study, a state machine with four states was built in the Unity3D environment, and the movement of a character was implemented by using reinforcement learning such that the character takes a ball in the stage right side area and transports it to the goal in the left side area. The performance, flexibility, etc. of this method are evaluated by comparing a model in which the training is split for each state of the method with a model trained by a single DNN.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.