JSAI2020

Presentation information

Organized Session

Organized Session » OS-25

[4F2-OS-25a] OS-25 (1)

Fri. Jun 12, 2020 12:00 PM - 1:40 PM Room F (jsai2020online-6)

熊野 史朗(NTT)、寺田 和憲(岐阜大学)、鈴木 健嗣(筑波大学)

12:40 PM - 1:00 PM

[4F2-OS-25a-02] Mathematical Representation of Emotion Using Multimodal Deep Neural Networks

Effects of the Number of Dimensions of Emotional Space on the Performance of Recognition and Unification Tasks

〇Seiichi Harata1, Takuto Sakuma1, Shohei Kato1,2 (1. Computer Science Program, Dept. of Engineering, Graduate School of Engineering, Nagoya Institute of Technology, 2. Frontier Research Institute for Information Science, Nagoya Institute of Technology)

Keywords:Affective Computing, Multi-modal, Deep Neural Networks, Multi-task Learning, Emotional Space

To emulate human emotions in robots, the mathematical representation of emotion is important for each component of affective computing, such as emotion recognition, generation, and expression. In a method that represents emotions by vectors of continuous values (Emotional Space), it is necessary to consider the number of dimensions of Emotional Space. In this study, we propose a method of integrating multimodalities on a DNN acquiring Emotional Space.
We aim at the acquisition of modality independent Emotional Space by combining the emotion recognition task and unification task of Emotional Space of each modality. Through the experiments with audio-visual data, we confirmed in various dimensions of Emotional Space that there are differences in Emotional Space acquired from uni-modality, and the proposed method can acquire a modality independent Emotional Space. We also investigated the compatibility of the recognition and the unification score by changing the number of dimensions of Emotional Space.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password