[3Rin2] Interactive Session 1

[3Rin2-48] Sleep/wake classification using remote PPG signals

Yawen Zhang¹, 〇Masanori Tsujikawa², Yoshifumi Onishi² (1. HKUST, 2. NEC)

Keywords:Remote PPG, Sleep/Wake Classification, Convolutional Neural Network, Noise Reduction, Heart Rate Variability

This paper proposes a remote sleep/wake classification method by combining vision-based heart rate (HR) estimation and convolutional neural network (CNN). Instead of directly inputting the estimated HR to CNN, we input remote PPG (Photoplethysmogram) signals filtered by a dynamic HR filter, which can overcome two main problems: low temporal resolution of estimated HR; much noise exists in the estimated remote PPG signals. Evaluation results show that the dynamic HR filter works more effectively compared to the static one, which helps improve AUC (area under the curve) index of the classification to 0.70, as good as the performance (0.71) of HR from a wearable sensor.