Back to Search
Start Over
An approach to named entity recognition towards micro-blog
- Source :
- Dianzi Jishu Yingyong, Vol 44, Iss 1, Pp 118-120 (2018)
- Publication Year :
- 2018
- Publisher :
- National Computer System Engineering Research Institute of China, 2018.
-
Abstract
- Named entity recognition is a fundamental technology in natural language processing(NLP). In recent years, rapid development of social network platforms such as microblog presents new challenges to the traditional named entity recognition(NER) technology because of the unique form. In this paper, an improved method based on the conditional random field(CRF) model is proposed for microblog texts. Due to the short texts and semantic ambiguity, external data resources are introduced to generate the topic feature and word representation feature for training the model. Due to the large-scale of microblog data and the high cost of manual standardization, an active learning algorithm based on least confidence is adopted to enhance the training effect at a lower cost of labor. Experiments on a Sina weibo data set show that this method improves the F-score by 4.54% compared to the traditional CRF methods.
Details
- Language :
- Chinese
- ISSN :
- 02587998
- Volume :
- 44
- Issue :
- 1
- Database :
- Directory of Open Access Journals
- Journal :
- Dianzi Jishu Yingyong
- Publication Type :
- Academic Journal
- Accession number :
- edsdoj.4f81eadffb394408aa6a3de648313513
- Document Type :
- article
- Full Text :
- https://doi.org/10.16157/j.issn.0258-7998.179024