[3E1-OS-5a] グループインタラクションとAI(1/2)

[3E1-OS-5a-01] Unified Protocol-Based Multimodal Data Collection in Group Discussion

〇Motoki SAKAI¹, Ren Ohmura², Shogo Okada³, Masaki Shuzo¹, Hirohiko Suwa⁴, Norihisa Segawa⁵, Kaori Fujinami⁶, Kazuya Murao⁷, Masahide Yuasa⁸ (1. Tokyo Denki University, 2. Toyohashi University of Technology, 3. Japan Advanced Institute of Science and Technology, 4. Nara Institute of Science and Technology, 5. Kyoto Sangyo University, 6. Tokyo University of Agriculture and Technology, 7. Ritsumeikan University, 8. Shonan Institute of Technology)

Keywords:Group discussion, multimodal sensor, AI

In this research, a consortium was formatted by 11 university including Tokyo Denki University to collect multimodal dataset in group discussion (GD) by the unified experimental protocol. So far, multimodal dataset, movies and, audio data were collected from two types GD: brain storming (BS) and GD aimed at consensus building. During GD, ECG; EMG; acceleration and angular velocity of user’s body and head; light of sight; pulse signal were measured as multimodal dataset. In addition, emotional annotation or classification tags were labeled for each utterance to analyze communication skills. Collected dataset will be able to be used for various purposes.