JSAI2019

Presentation information

Organized Session

Organized Session » [OS] OS-11

[4F3-OS-11b] 社会的信号処理とAI(2)

Fri. Jun 7, 2019 2:00 PM - 3:00 PM Room F (302B Medium meeting room)

岡田 将吾(北陸先端科学技術大学院大学)、石井 亮(NTT)

2:00 PM - 2:20 PM

[4F3-OS-11b-01] Considering Idling Motion Generation using RNNs for Virtual Conversational Agents

〇Hung-Hsuan Huang1,2, Masato Fukuda1, Toyoaki Nishida1,2 (1. RIKEN Center for Advanced Intelligence, 2. Graduate School of Informatics, Kyoto University)

Keywords:machine learning, active listening, virtual agent

This work aims to develop a model to generate fine grained and reactive non-verbal behaviors

of the virtual character when the human user is talking to it.

The target non-verbal idling behaviors are micro facial expression, head movements, and postures.

We explored the use of recurrent neural network (RNN) to learn these behaviors

in reacting to the human communication interlocutor's corresponding micro non-verbal behaviors.

The models are trained on an active listening data corpus which

features elderly speakers talking with young active listeners and was collected by ourselves.