Search

This paper reports how we build a Chinese Grammatical Error Diagnosis system in the NLPTEA-2018 CGED shared task. In 2018, we sent three runs with three different approaches. The first one is a pattern-based approach by frequent error pattern matching. The second one is a sequential labelling approach by conditional random fields (CRF). The third one is a rewriting approach by sequence to sequence (seq2seq) model. The three approaches have different properties that aim to optimize different performance metrics and the formal run results show the differences as we expected.

With the prevalence of Social Networking Services (SNS), real-world consumption behaviors are influenced from reality to social networks. In order to utilize the information from social network, we need a concept space that can alter with application domain. In the presence of new vocabulary and continuously growing, and automatic ontology construction has been an important issue. There are previous studies concerning free-format ontology construction, enriching given ontologies from web or corpus sources, and construction of ontology from semi-structural corpora; among these studies, semi-structural corpora have been prevailing studies. In this thesis, we developed an adaptive framework for cross corpora on social collaborative editing, and we focus on semi-structural text mining in particular. The framework involves detection of named entity in a document, filtering of named entity, disambiguation detection, named entity expansion and ranking of the related named entity. We describe how this framework in detail and proposed method for each stage, and the metrics in the previous studies and the one we used for evaluation. We then discuss the evolution and quality of concept space. Our proposed framework made real-world corpora computationally possible, and a dynamic concept space is generated from this framework. It could deal with more diverse domains and languages, and for pragmatic real-world applications, our method shows better flexibility than previous studies. The research result can avoid the costly mistake of designing various mechanism and provide user adoption analysis and digital marketing strategy via online/offline in adopting this kind of innovation service.

We introduce a method that extracts keywords in a language with the help of the other. The method involves estimating preferences for topical keywords and fusing language-specific word statistics. At run-time, we transform parallel articles into word graphs, build crosslingual edges for word statistics integration, and exploit PageRank with word keyness information for keyword extraction. We apply our method to keyword analysis and language learning. Evaluation shows that keyword extraction benefits from cross-language information and language learners benefit from our keywords in reading comprehension test.

This paper reports how to build a Chinese Grammatical Error Diagnosis system based on the conditional random fields (CRF). The system can find four types of grammatical errors in learners’ essays. The four types or errors are redundant words, missing words, bad word selection, and disorder words. Our system presents the best false positive rate in 2015 NLP-TEA-2 CGED shared task, and also the best precision rate in three diagnosis levels.