[2C1-GS-12] Human interface, education aid: Estimating states in education (1)

[2C1-GS-12-04] Learning Environment for Sketching Human Body suitable for Free Pose Change by using a Drawing Doll as a Tangible Interface

〇Masato Soga¹, Hiroki Inatome¹ (1. Wakayama University)

Keywords:Learning support, sketch, drawing human body

In this study, we propose a method in which the learner uses the drawing doll as a tangible user interface and changes the posture of the virtual humanoid motif by changing the posture of the drawing doll. Then, we developed a human body sketch learning system that automatically diagnoses human body drawings drawn by learners and visualizes deviations from motifs. Specifically, the pose function estimates the skeleton by OpenPose from the captured image of the drawing doll acquired by the Web camera. In the portrait sketch support function, the skeleton and the outline calculated from the virtual humanoid motif are superimposed and displayed on the sketch result of the learner in a form in which an error with the target is visualized. It gives learners a notice of errors. After constructing the system, subjects were recruited and an evaluation experiment of this system was performed, and the results were considered.