[3R1-OS-13b] OS-13

[3R1-OS-13b-03] Analysis of Communication Characteristics of Adults with ASD in Group Conversations

〇Chisa Kobayashi¹, Ibuki Hoshina¹, Tatsuya Sakato¹, Fumio Nihei², Ryo Ishii², Atsushi Fukayama², Masatsugu Tsujii^3,1,4, Kalin Stefanov^5,1, Yukiko Nakano¹ (1. Seikei University, 2. NTT Human Informatics Laboratories, 3. Chukyo University, 4. Asperger Society Japan, 5. Monash University)

Keywords:Autism Spectrum Disorder, Group Conversations, Multimodal Interaction

Aiming at reducing communication difficulties between people with ASD and neuro-typical people, this study proposes deep neural network models that detect miscommunication in group discussions that people with ASD participate. First, we collected group conversation corpus among three people, including one diagnosed with ASD. Then, we defined "Miscommunication" by breaking down into two sub-categories: interaction issues (engagement, turn-taking, conversation context) and ASD specific issues. We annotated miscommunication based on these definitions, and used the annotation as ground truth in training machine learning models. We created multimodal transformer-based models using audio, facial, and language information, and found that the model performance of detecting miscommunication was 0.713 for F1-score and 0.652 for Accuracy. These results indicate the possibility of automatically detecting miscommunication in group discussions with people with ASD.