Presentation information

International Session

International Session » [ES] E-2 Machine learning

[2H4-E-2] Machine learning: fusion of models

Wed. Jun 5, 2019 3:20 PM - 5:00 PM Room H (303+304 Small meeting rooms)

Chair: Naohiro Matsumura (Osaka University)

3:20 PM - 3:40 PM

[2H4-E-2-01] Curiosity Driven by Self Capability Prediction

〇Nicolas Bougie1,2, Ryutaro Ichise2,1 (1. Sokendai, The Graduate University for Advanced Studies, 2. National Institute of Informatics)

Keywords:reinforcement learning, machine learning, exploration in reinforcement learning

Reinforcement learning is a powerful method to solve tasks using a reward signal; however, it struggles in sparse reward scenarios. One solution to this problem is the use of reward shaping but, it requires complicated human engineering in complex environments. Instead, our solution relies on exploration driven by curiosity. In this paper, we formulate the curiosity as the ability of the agent to predict its knowledge about the task. The prediction is based on the combination of intermediate goals and deep learning. Our end-to-end method scales to high-dimensional state spaces such as images. As proof-of-concept, we present a preliminary implementation of our algorithm using only raw pixels as input.