[3E5-GS-10] AI application: Medicine / Healthcare

[3E5-GS-10-03] Estimation of Mental Health Based on Individual Response Characteristics using a Smart Mirror

〇Taiga Noguchi¹, Masakazu Hirokawa², Shotaro Doki¹, Kenji Suzuki¹ (1. Univ. of Tsukuba, 2. Co.NEC)

Keywords:Mental health, Audiovisual features, Smart Mirror, Dialogue system, Response characteristics

In this study, we developed a smart mirror, a device for estimating and measuring mental health based on individual response characteristics through simple interactive interaction. More than 320 million people suffer from mental illness worldwide but delayed detection of mental illness cause severe psychosis and, worst of all, suicides.Research has shown that early detection and early intervention have a dominant effect on remission in many cases of mental illness, and daily monitoring is essential for early detection. Therefore, we proposed a mental health estimation method that quantifies individual response characteristics based on device-based measurement and uses labeling by physicians as supervised data. In this study, we used a smart mirror as a measurement device, as we hypothesized that measuring individual response characteristics from simple interactions would reduce the burden of measurement on the user and enable stable data measurement. The results show that mental health can be estimated by using a sequential estimation method that classifies negative and neutral/positive responses based on the individual response characteristics obtained through a short interaction. This study shows that smart mirrors provide an objective, efficient, and non-invasive approach to mental health estimation and new possibilities in mental health care.