Presentation information

Oral presentation

General Session » [General Session] 12. HI / Education Aid

[2K2] [General Session] 12. HI / Education Aid

Wed. Jun 6, 2018 1:20 PM - 3:00 PM Room K (3F Azisai Mokuren)

座長:瀬田 和久(大阪府立大学)

2:20 PM - 2:40 PM

[2K2-04] Development and Evaluation of a AR Drawing System suitable for real time gripping movement by using Kinect

〇Hiroki Inatome1, Masato Soga1 (1. Wakayama University)

Keywords:Kinect, Point Cloud, Augmented Reality, Object Tracking

Virtual human figures have been used in the conventional human figure sketch learning support system. A learner selects one of the virtual figures for a motif. However, the learner could not intuitively manipulate the virtual human figure in real time to change the posture of the figure for learner’s favorite pose. Therefore, in this research, we propose a method to change the posture of the virtual figure model intuitively by using the drawing doll as a tangible interface. Specifically, it uses PCL which can acquire point cloud data from RGB-D camera with KINECT, then it acquires and tracks the three-dimensional coordinates of the real object and superimposes and displays the virtual human figure on the real drawing doll. In the verification experiment tracking accuracy was verified and the improvement of the system was discussed.