Back to Search Start Over

A fine-grained Chinese word segmentation and part-of-speech tagging corpus for clinical text.

Authors :
Xiong, Ying
Wang, Zhongmin
Jiang, Dehuan
Wang, Xiaolong
Chen, Qingcai
Xu, Hua
Yan, Jun
Tang, Buzhou
Source :
BMC Medical Informatics & Decision Making. 4/9/2019 Supplement 2, Vol. 19, pN.PAG-N.PAG. 1p. 1 Diagram, 5 Charts.
Publication Year :
2019

Abstract

<bold>Background: </bold>Chinese word segmentation (CWS) and part-of-speech (POS) tagging are two fundamental tasks of Chinese text processing. They are usually preliminary steps for lots of Chinese natural language processing (NLP) tasks. There have been a large number of studies on CWS and POS tagging in various domains, however, few studies have been proposed for CWS and POS tagging in the clinical domain as it is not easy to determine granularity of words.<bold>Methods: </bold>In this paper, we investigated CWS and POS tagging for Chinese clinical text at a fine-granularity level, and manually annotated a corpus. On the corpus, we compared two state-of-the-art methods, i.e., conditional random fields (CRF) and bidirectional long short-term memory (BiLSTM) with a CRF layer. In order to validate the plausibility of the fine-grained annotation, we further investigated the effect of CWS and POS tagging on Chinese clinical named entity recognition (NER) on another independent corpus.<bold>Results: </bold>When only CWS was considered, CRF achieved higher precision, recall and F-measure than BiLSTM-CRF. When both CWS and POS tagging were considered, CRF also gained an advantage over BiLSTM. CRF outperformed BiLSTM-CRF by 0.14% in F-measure on CWS and by 0.34% in F-measure on POS tagging. The CWS information brought a greatest improvement of 0.34% in F-measure, while the CWS&POS information brought a greatest improvement of 0.74% in F-measure.<bold>Conclusions: </bold>Our proposed fine-grained CWS and POS tagging corpus is reliable and meaningful as the output of the CWS and POS tagging systems developed on this corpus improved the performance of a Chinese clinical NER system on another independent corpus. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
14726947
Volume :
19
Database :
Academic Search Index
Journal :
BMC Medical Informatics & Decision Making
Publication Type :
Academic Journal
Accession number :
135796248
Full Text :
https://doi.org/10.1186/s12911-019-0770-7