[4D4-OS-4c] Affective Computing(3/3)

[4D4-OS-4c-02] Proposition of Multimodal Dialogue System Reflecting Human Emotions

〇Yuki Samei¹, Komei Hiruta¹, Satoshi Suga¹, Yoji Kawano¹, Eichi Takaya¹, Yoshihiko Kato¹, Satoshi Kurihara² (1. Graduate School of Science and Technology, Keio University, 2. Faculty of Science and Technology, Keio University)

Keywords:Affective Computing, Dialogue System, Multimodal Interface

One of the reasons why current dialogue systems can not interact like humans is that these systems lack an ability of reflecting human emotions in interaction. In this study, we develop a new dialogue system that interacts by using multimodal emotions such as facial expressions, tone of voice, and speech content. When the multimodal emotion values obtained from the user are input into the system, it speaks with displaying pictograms with facial expressions appropriate to each situation. Experiment was conducted by preparing a comparison model. And the results showed that the proposed model can display more appropriate facial expressions.