[9p-Z28-1~19] FS.1 Focused Session "AI Electronics"

[9p-Z28-18] Q-Learning based on Chaotic Laser Time Series

〇(M1)Takashi Urushibara¹, Nicolas Chauvet¹, Satoshi Kochi², Satoshi Sunada², Kazutaka Kanno³, Atsushi Uchida³, Makoto Naruse¹ (1.Tokyo Univ., 2.Kanazawa Univ., 3.Saitama Univ.)

Keywords:Laser chaos, Q-Learning

Q-Learning is a reinforcement learning method wherein evaluation values for actions are adapted for multiple states. In this study, we regard a Q-learning system as a parallel array of multi-armed bandit problems to search for a better action for each state while using chaotic laser time series. The method exhibits superior performances compared to other methods such as randomly-shuffled chaotic laser time series, uniformly and normally distributed random numbers, indicating that the temporal structure inherent in chaos may provide positive effects.