Towards the integration of spontaneous speech and gesture based on spotting method

A spotting algorithm to recognize the meanings of human gestures from motion images is proposed. Feature vectors are extracted from temporal edge image. And input image sequences are matched with models by spotting algorithm. The spotting algorithm removes the need for temporal segmentation of gesture duration and introduces frame-wise recognition. In this paper, a new spotting method called nonmonotonic continuous DP is proposed for spotting gestures and their variations such as reverse, partial and stop motions. We showed the effectiveness of the new spotting method.