1. Deep Graph-Based Character-Level Chinese Dependency Parsing
- Author
-
Linzhi Wu and Meishan Zhang
- Subjects
Parsing ,Acoustics and Ultrasonics ,Computer science ,business.industry ,Text segmentation ,computer.software_genre ,Part of speech ,030507 speech-language pathology & audiology ,03 medical and health sciences ,Computational Mathematics ,Dependency grammar ,Computer Science (miscellaneous) ,Feature (machine learning) ,Graph (abstract data type) ,Artificial intelligence ,Electrical and Electronic Engineering ,0305 other medical science ,business ,Representation (mathematics) ,computer ,Natural language processing ,Word (computer architecture) - Abstract
Character-level Chinese dependency parsing has been a concern of several studies that naturally handle word segmentation, POS (Part of Speech) tagging and dependency parsing jointly in an end-to-end way. Previous work mostly concentrates on a transition-based framework for this task because of its easy adaption, which is extremely important when feature representation relies heavily on the decoding strategy, particularly under the traditional statistical setting. Recently, on the one hand, sophisticated deep neural networks and deep contextualized word representations have greatly weakened the dependence between feature representation and decoding. On the other hand, (first-order) graph-based models, especially the biaffine parsers, are straightforward for dependency parsing, and meanwhile they can yield competitive parsing performance. In this paper, we make a comprehensive investigation of the deep graph-based character-level dependency parsing for Chinese. We start from an extension of a standard graph-based biaffine parser, and then exploit Chinese BERT as well as our improved encoders based on transformers to enhance the character-level dependency parsing model. We conduct a series of experiments on the Chinese benchmark datasets, showing the performances of various graph-based character-level models and analyzing the advantages of the character-level dependency parsing under the deep neural setting.
- Published
- 2021