Presentation information

Organized Session

Organized Session » OS-18

[2D5-OS-18b] OS-18 (2)

Wed. Jun 10, 2020 3:50 PM - 5:30 PM Room D (jsai2020online-4)

岩澤 有祐(東京大学)、鈴木 雅大(東京大学)、山川 宏(東京大学/全脳アーキテクチャ・イニシアティブ)、松尾 豊(東京大学)

5:10 PM - 5:30 PM

[2D5-OS-18b-05] Towards Explainable Autonomous Agents Considering Human Receptivity

〇Tatsuya Sakai1, Kazuki Miyazawa1, Tatsuya Aoki1,2, Takato Horii1, Takayuki Nagai1,2 (1. Osaka University, 2. The University of Electro-Communications)

Keywords:explainability, world model, autonomous agent

An explainable AI attracts attention from many machine learning researchers because the reason why the AI system outputs the result is important to accept the AI in human society. However, studies about acceptable decision-making and explanations by autonomous agents such as robots have not been studied yet. For generating human-friendly descriptions, it is crucial to provide minimum necessity information for human understanding. To tackle this issue, we propose a generation method of human-acceptable explanations for a decision-making agent using reinforcement learning. The proposed method employs a world predictive model to identify the critical situation for practical explanations. We verify the proposed method in a simple MDP situation which requires to access plural states to get rewards. Experimental results show that our method can generate a minimum necessity explanation for human questions in a grid maze world.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.