JSAI2024

Presentation information

Poster Session

Poster session » Poster session

[4Xin2] Poster session 2

Fri. May 31, 2024 12:00 PM - 1:40 PM Room X (Event hall 1)

[4Xin2-19] Robustness Verification in Robot Control Using Decision Transformer

〇XIYING DONG1, Tsuyoshi Takano1, Hiroshi Kera2, Kzuhiko Kawamoto2 (1.Graduate School of Science and Engineering Chiba University, 2.Faculty of Engineering Chiba University)

Keywords:Reinforcement Learning, transformer, robustness, MUJOCO

To verify the robustness of Decision Transformer in robot control, Decision Transformer is an off-line reinforcement learning model using Transformer, which has been reported to perform as well as or better than conventional reinforcement learning. In this study, we evaluate the robustness of Decision Transformer using three robots (Half Cheetah, Hopper, and Walker2D) for failure cases that are not included in the collected data for offline reinforcement learning. The robustness evaluation simulates a situation where the actuator does not work for the three datasets (Medium-Expert, Medium, and Medium-Replay). Experimental results confirmed a trend toward lower rewards for all robots for all three datasets. This result indicates that the Decision Transformer needs to be made more robust.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password