[1ATE] Art & Tech Exhibition A

[T-27A] Interactive Virtual Reality Speech Simulation System using Autonomous Audience with Natural Non-verbal Behavior

○Justin Andrew Liao¹, Nobuyuki Jincho¹, Hideaki Kikuchi¹ (1. Waseda university)

Public speaking anxiety (PSA) is a fear of speaking in front of others. Most people experience a certain amount of anxiety in public speaking situation. This study aims to help people overcome PSA using an interactive VR simulation system with real-life scenarios. We develop a multimodal VR speech simulation system using autonomous audience with natural non-verbal behavior to enhance users' sense of presence. Additionally, real-time multimodal feedback is produced by virtual audience based on users' public speaking behavior which automatically analyzed by multimodal sensors (e.g. microphone, motion capture, heart rate monitor).