[2I6-OS-9b] Affective Computing(2/2)

[2I6-OS-9b-03] Collecting Online Counseling Multimodal Data Corpus and Analysis of Behavioral Synchrony

〇Ryota Matsukuma¹, Shogo Okada¹, Maiko Matsumoto², Atsushi Nakamoto² (1. Japan Advanced Institute of Science and Technology, 2. Future Corporation)

Keywords:Synchrony, Social signal processing, Consulting interaction, Persuasion

Research on social signal processing is being conducted to compute and understand the aspects of sociality that humans form through communication and behavior from multimodal information observed from communicators. In recent years, machine learning methods have been proposed to model the skills of communicators. We collected data on online counseling and created a multimodal corpus for the purpose of analyzing and modeling the consultation skills of professional advisors. The data corpus is composed of images, voices, utterances of counselors and client, and empathic label. In this paper, we outline the corpus and report the results of the initial analysis, focusing on the synchrony of the actions both counselor and client in estimating the scenes in which the counselor and client gained empathy and the client gained conviction.