JSAI2024

Presentation information

Organized Session

Organized Session » OS-13

[3R1-OS-13b] OS-13

Thu. May 30, 2024 9:00 AM - 10:40 AM Room R (Room 51)

オーガナイザ:酒井 元気(日本大学)、岡田 将吾(北陸先端科学技術大学院大学)、湯浅 将英(湘南工科大学)、近藤 一晃(京都大学)、下西 慶(京都大学)

10:20 AM - 10:40 AM

[3R1-OS-13b-05] Estimating Social Responsiveness of Adults with ASD in Group Conversations

〇Ibuki Hoshina1, Chisa Kobayashi1, Tatsuya Sakato1, Fumio Nihei2, Ryo Ishii2, Atsushi Fukayama2, Masatsugu Tsujii3,1,4, Kalin Stefanov5,1, Yukiko Nakano1 (1. Seikei University, 2. NTT Human Informatics Laboratories, 3. Chukyo University, 4. Asperger Society Japan, 5. Monash University)

Keywords:Autism Spectrum Disorder, Group Conversations, Multimodal Interaction

ASD (autism spectrum disorder) is a developmental disorder with problems in social communication. The diagnosis of ASD is usually made in childhood, but there are some individuals who have communication problems but are not diagnosed until later in life. Early detection of such individuals and appropriate treatment and support are important issues. The Social Responsiveness Scale was developed to objectively measure symptoms associated with ASD, making it suitable for ASD screening. In this study, we propose machine learning models that estimate SRS-2 scores using multimodal information from group communication videos. First, as an analysis of the communication characteristics of adults with ASD, we examined the features that significantly correlate with the SRS-2 scores. Next, based on these results, we created estimation models using audio, facial, and language features. Ablation studies revealed that combining features from multiple modalities improved estimation performance.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password