JSAI2022

Presentation information

Organized Session

Organized Session » OS-12

[3H3-OS-12a] グループインタラクションとAI(1/2)

Thu. Jun 16, 2022 1:30 PM - 3:10 PM Room H (Room H)

オーガナイザ:酒造 正樹(東京電機大学)[現地]、湯浅 将英(湘南工科大学)、岡田 将吾(北陸先端科学技術大学院大学)、酒井 元気(日本大学)、近藤 一晃(京都大学)、中野 有紀子(成蹊大学)

2:50 PM - 3:10 PM

[3H3-OS-12a-05] Explainable Models for Predicting Interlocuters’ Subjective Impressions based on Nonverbal Functional Features

When and What Kind of Behaviors Affected Interlocuters’ Impressions?

〇Shumpei Otsuchi1, Kazuki Miyoshi1, Yoko Ishii2, Ryo Ishii2, Shin-ichiro Eitoku2, Kazuhiro Otsuka1 (1. Yokohama National University, 2. Nippon Telegraph and Telephone Corporation)

Keywords:Nonverbal Behavior, Social Signal Processing, Multiparty Conversation, Deep Learning, Explainable AI

An explainable framework is proposed to predict the interlocutors' subjective impressions in group meetings. The goal is to explain when and what kind of nonverbal behaviors affected interlocutors' impressions during meetings. To that end, we formulate a two-fold framework consisting of the regression models of interlocutors' impression scores based on functional head-movement features, followed by the estimation of the temporal distribution of SHAP-based feature contribution, which is obtained with the kernel density estimation of the temporal occurrence probabilities of head-movement functions. The former stage identifies the behaviors related to the impressions, and the later stage suggests the timing of the behaviors, by locating the maximum point of the temporal feature contribution curve, based on an assumption that temporary intensive behaviors lead to form a strong impression. This report shows preliminary results and analyses applied to 4-party 17-group discussions.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password