Presentation information

General Session

General Session » GS-3 Knowledge utilization and sharing

[4M3-GS-3] Knowledge utilization and sharing: knowledge structure

Fri. Jun 17, 2022 2:00 PM - 3:40 PM Room M (Room B-2)

座長:石井 岳(東芝)[遠隔]

3:20 PM - 3:40 PM

[4M3-GS-3-05] RL Agents with Commonsense Knowledge from Scene Graphs

Tsunehiko Tanaka1,2, 〇Daiki Kimura2, Michiaki Tatsubori2 (1. Waseda University, 2. IBM Research)

Keywords:Common Sense, Scene Graph, Reinforcement Learning

Text-based games are becoming commonly used in reinforcement learning and natural language processing. To challenge these games, it is effective to make the search of the action space more efficient by giving common sense. However, such knowledge has only been available from textual information with a high level of abstraction in previous works. In this paper, we propose to employ common sense reasoning obtained from visual datasets such as scene graph datasets. In general, images convey more comprehensive information compared with text for humans. This property enables to extract commonsense relationship knowledge more useful for acting effectively in a game. We also experimented with our proposed methods on a text-based game task that requires commonsense reasoning. Our experimental results showed that our proposed methods have higher and competitive performance than existing state-of-the-art methods.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.