251. Implementation of Speaking SoftMan in Game
- Author
-
Xuyan Tu, Yixin Yin, Xiangyang Huang, and Guangping Zeng
- Subjects
Vertex (computer graphics) ,Computer science ,Speech recognition ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Speech synthesis ,Animation ,Viseme ,computer.software_genre ,Morphing ,Human–computer interaction ,Scripting language ,computer ,Shader ,Computer animation ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
Unlike traditional NPCs (nonplayer characters) which are just "smart" programs, this thesis considers SoftMans as NPC model, which live in a simulated world and have a synthetic body with autonomous behaviors. Based on this novel idea, we research text-driven lip motion synthesis system for SoftMan in game. First, we divide Chinese phonemes into 11 basic static visemes in which whole 3D virtual face is considered. Secondly, text scripts are divided into phoneme sequences. Thirdly, proper intermediate animation frames are created by morphing technique. Finally, those frames are rendered by vertex shader technique
- Published
- 2006