1. Using Few-Shot Learning Techniques for Named Entity Recognition and Relation Extraction
- Author
-
Sergey Berezin, Alexey Pauls, Yuliya Rubtsova, Tatiana Batura, Ivan Bondarenko, and Bair Tuchinov
- Subjects
Group method of data handling ,business.industry ,Computer science ,Supervised learning ,Construct (python library) ,computer.software_genre ,Machine learning ,Relationship extraction ,ComputingMethodologies_PATTERNRECOGNITION ,Named-entity recognition ,Benchmark (computing) ,Unsupervised learning ,Artificial intelligence ,business ,Transfer of learning ,computer - Abstract
This paper presents new methods for entity recognition and relation extraction tasks on partially labeled and unlabeled datasets. The proposed methods are based on techniques of semi-supervised, unsupervised and the transfer learning. We use the few-shot learning technique to construct specific algorithms for the new data sources without manual retraining. To compare the results with other studies, we conducted experiments on two benchmark datasets for the Russian language. The results for named entity recognition demonstrate significant improvement and outperform the state-of-the-art results. Our results for relation extraction are comparable to other research. We assume that a longer BERT fine-tuning will help to improve them, and we also plan to experiment with other few-shot learning methods in the near future.
- Published
- 2020