1. Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs
- Author
-
Juhyun Oh, Sangwook Kang, Seonggyu Jeon, Hyuk-Chul Kwon, Byungsun Kim, Iktae Kim, Youngho Song, and Minho Kim
- Subjects
Closed captioning ,Computer science ,Speech recognition ,05 social sciences ,WordNet ,020207 software engineering ,02 engineering and technology ,Sign language ,computer.software_genre ,Broadcasting (networking) ,Scripting language ,0502 economics and business ,Synonym (database) ,0202 electrical engineering, electronic engineering, information engineering ,Media Technology ,Electrical and Electronic Engineering ,computer ,050203 business & management ,Word (computer architecture) ,Avatar - Abstract
Whereas the closed-caption broadcasting is provided for almost the whole broadcast time in Korea, the sign language interpretation is not. By translating the realtime closed captions, it is possible to provide three-dimensional (3D) sign language translations for more broadcast time. We propose a sign language broadcasting system for weather forecasts and extend it for all kinds of TV programs. To find the frequency of each word, we analyzed the last three years' weather forecast scripts, and an open-domain corpus of about 1.2 million words from the Korean Broadcasting System. We use KorLex, the Korean wordnet, to build the sign language synonym dictionary and for the word sense disambiguation to improve the translation performance. Optically captured sign language motions are used for the 3D avatar to present sign language with motion blending. We developed a mobile on-demand sign language weather forecast application and a realtime sign language interpretation system for all kinds of TV programs.
- Published
- 2017