Back to Search
Start Over
An ensemble of transliteration models for information retrieval
- Source :
- Information Processing & Management. 42:980-1002
- Publication Year :
- 2006
- Publisher :
- Elsevier BV, 2006.
-
Abstract
- Transliteration is used to phonetically translate proper names and technical terms especially from languages in Roman alphabets to languages in non-Roman alphabets such as from English to Korean, Japanese, and Chinese. Because transliterations are usually representative index terms for documents, proper handling of the transliterations is important for an effective information retrieval system. However, there are limitations on handling transliterations depending on dictionary lookup, because transliterations are usually not registered in the dictionary. For this reason, many researchers have been trying to overcome the problem using machine transliteration. In this paper, we propose a method for improving machine transliteration using an ensemble of three different transliteration models. Because one transliteration model alone has limitation on reflecting all possible transliteration behaviors, several transliteration models should be complementary used in order to achieve a high-performance machine transliteration system. This paper describes a method about transliteration production using the several machine transliteration models and transliteration ranking with web data and relevance scores given by each transliteration model. We report evaluation results for our ensemble transliteration model and experimental results for its impact on IR effectiveness. Machine transliteration tests on English-to-Korean transliteration and English-to-Japanese transliteration show that our proposed method achieves 78-80% word accuracy. Information retrieval tests on KTSET and NTCIR-1 test collection show that our transliteration model can improve the performance of an information retrieval system about 10-34%.
- Subjects :
- Information retrieval
Computer science
business.industry
InformationSystems_INFORMATIONSTORAGEANDRETRIEVAL
Automatic processing
Library and Information Sciences
Management Science and Operations Research
Report evaluation
computer.software_genre
ComputingMethodologies_ARTIFICIALINTELLIGENCE
Computer Science Applications
Ranking (information retrieval)
Word accuracy
ComputingMethodologies_PATTERNRECOGNITION
Index (publishing)
Media Technology
Transliteration
Proper noun
Relevance (information retrieval)
Artificial intelligence
business
computer
Natural language processing
Information Systems
Subjects
Details
- ISSN :
- 03064573
- Volume :
- 42
- Database :
- OpenAIRE
- Journal :
- Information Processing & Management
- Accession number :
- edsair.doi...........1828d28fad2681eb6bc566ef4794fe77