[4E2-OS-11b] 人間と共生する対話知能(2/4)

[4E2-OS-11b-03] Statistical Dialogue System Considering Non-verbal Emotion Expression

〇Kazuya MERA¹, Mayuna ISHIDA¹, Shunsuke HABARA¹, Yoshiaki KUROSAWA¹, Toshiyuki TAKEZAWA¹ (1. Hiroshima City University)

Keywords:non-verbal emotion expression, statistical dialogue system, emoticon, BERT

To deal with user’s emotion on rule-based dialogue system, vast number of rules should be prepared because the number of rules are multiplied by the type of emotions. On the other hand, although statistical dialogue system is robust for various inputs, it can deal with only text information. This paper proposes a statistical dialogue system which can deal with user’s emotions by converting them into emojis. The user’s emotion is estimated from tone of the user’s voice and appended to the tail of input sentence as an emoji. Then, emoji in output sentence is considered as the agent’s emotion when the output voice is synthesized. The question-answer pairs including emojis are collected from tweet-reply pairs on Twitter, and the pairs are also used for fine-tuning. Experimental result revealed that reply utterances by the proposed method were more suitable for user’s emotions than that by no-emoji method.