1. Unsupervised discovery of morphologically related words based on orthographic and semantic similarity
- Author
-
Johannes Matiasek, Marco Baroni, and Harald Trost
- Subjects
FOS: Computer and information sciences ,Computer Science - Computation and Language ,Computer science ,business.industry ,I.2.7 ,Orthographic projection ,Affix ,Concatenation ,Pattern recognition ,Mutual information ,computer.software_genre ,language.human_language ,Substring ,German ,Semantic similarity ,Morpheme ,language ,Edit distance ,Artificial intelligence ,business ,computer ,Computation and Language (cs.CL) ,Natural language processing - Abstract
We present an algorithm that takes an unannotated corpus as its input, and returns a ranked list of probable morphologically related pairs as its output. The algorithm tries to discover morphologically related pairs by looking for pairs that are both orthographically and semantically similar, where orthographic similarity is measured in terms of minimum edit distance, and semantic similarity is measured in terms of mutual information. The procedure does not rely on a morpheme concatenation model, nor on distributional properties of word substrings (such as affix frequency). Experiments with German and English input give encouraging results, both in terms of precision (proportion of good pairs found at various cutoff points of the ranked list), and in terms of a qualitative analysis of the types of morphological patterns discovered by the algorithm., Comment: 10 pages, to appear in the Proceedings of the Morphology/Phonology Learning Workshop of ACL-02
- Published
- 2002
- Full Text
- View/download PDF