Development of an AR Drawing System with Point Cloud Data suitable for Real-time Gripping Movement by using Kinect.

Virtual human figures have been used in the conventional human figure sketch learning support system. A learner selects one of the virtual figures for a motif. However, the learner could not intuitively manipulate the virtual human figure in real time to change the orientation of the figure for learner’s favorite viewpoint. Therefore, in this research, we developed a system to change the orientation of the virtual model of human figure intuitively by using the drawing doll as a tangible interface. Specifically, it uses PCL which can acquire point cloud data by RGB-D camera of KINECT, then it acquires and tracks the three-dimensional coordinates of the real object and superimposes and displays the virtual human figure on the real drawing doll. In the verification experiment tracking accuracy was verified and the improvement of the system was discussed. [ABSTRACT FROM AUTHOR]