12:40 PM - 1:00 PM
[4F2-OS-25a-02] Mathematical Representation of Emotion Using Multimodal Deep Neural Networks
Effects of the Number of Dimensions of Emotional Space on the Performance of Recognition and Unification Tasks
Keywords:Affective Computing, Multi-modal, Deep Neural Networks, Multi-task Learning, Emotional Space
To emulate human emotions in robots, the mathematical representation of emotion is important for each component of affective computing, such as emotion recognition, generation, and expression. In a method that represents emotions by vectors of continuous values (Emotional Space), it is necessary to consider the number of dimensions of Emotional Space. In this study, we propose a method of integrating multimodalities on a DNN acquiring Emotional Space.
We aim at the acquisition of modality independent Emotional Space by combining the emotion recognition task and unification task of Emotional Space of each modality. Through the experiments with audio-visual data, we confirmed in various dimensions of Emotional Space that there are differences in Emotional Space acquired from uni-modality, and the proposed method can acquire a modality independent Emotional Space. We also investigated the compatibility of the recognition and the unification score by changing the number of dimensions of Emotional Space.
We aim at the acquisition of modality independent Emotional Space by combining the emotion recognition task and unification task of Emotional Space of each modality. Through the experiments with audio-visual data, we confirmed in various dimensions of Emotional Space that there are differences in Emotional Space acquired from uni-modality, and the proposed method can acquire a modality independent Emotional Space. We also investigated the compatibility of the recognition and the unification score by changing the number of dimensions of Emotional Space.
Authentication for paper PDF access
A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.