[4Xin2] Poster session 2

[4Xin2-07] Dialogue Breakdown Analysis in a Multi-Agent Non-Task-Oriented Conversation

〇Ryosuke Oshima¹, Koshi Makihara², Fumiya Matsuzawa^2,3, Seitaro Shinagawa⁵, Yanjun Sun², Shigeo Morishima⁴, Hirokatsu Kataoka² (1.Waseda University, 2.National Institute of Advanced Industrial Science and Technology , 3.University of Tsukuba, 4.Waseda Research Institute for Science and Engineering, 5.Nara Institute of Science and Technology)

Keywords:Dialogue system, Conversation and Discourse Analysis, Non-Task-Oriented Conversation, Multi-agent

In this study, we analyze utterances that cause dialogue breakdown in multi-agent non-task-oriented conversation using a Large Language Model (LLM). Although simulations of human behavior using agents based on large-scale language models have been proposed, it is crucial to analyze the content of the dialog, which is one of the key factors in achieving more reliable simulations.
We investigate the tendency of LLM agents' utterances to cause breakdowns in non-task-oriented dialogues. We annotate the causes of failure for the dialogue between the two agents, given the theme and the attributes of the agents. As a result of our analysis of the typology of utterances that lead to dialogue breakdowns, we found speech errors specific to LLM agents.