Back to Search Start Over

Few-shot multi-domain text intent classification with Dynamic Balance Domain Adaptation Meta-learning.

Authors :
Yang, Shun
Du, YaJun
Liu, Jia
Li, XianYong
Chen, XiaoLiang
Gao, HongMei
Xie, ChunZhi
Li, YanLi
Source :
Expert Systems with Applications. Dec2024:Part A, Vol. 255, pN.PAG-N.PAG. 1p.
Publication Year :
2024

Abstract

User intents are ever-changing, which requires deep learning models to have the ability to classify unknown intents. Meta-learning aims to solve this problem by improving the model's generalization ability to unknown intent. However, learning on a small amount of text can easily lead to overfitting of the model. Domain adaptation can help us train a more robust model. However, most existing methods only focus on global feature alignment and ignore alignment in subdomains. Therefore, in this study, we first consider the case where the model can maintain robustness with a small amount of data and then explore and mine the higher quality transferable features. Based on these ideas, we propose Dynamic Balance Domain Adaptation Meta-learning (DBDAML), which adaptively learns higher quality transferable features in both the global domain and subdomains. 1 1 in this paper, each subdomain represents the domain under a separate class. At the same time, we define a dynamic balance factor to enable DBDAML to dynamically focus on the global domain and subdomains. This allows the model to give different attention to different domain adaptations and prevents it from overfitting of a domain feature alignment. The dynamic balance factor is estimated by the contribution of different domain discriminators to the loss, which also makes it easy to calculate and accurate. Finally, we use the meta-learning framework to model the entire theoretical idea. Extensive experiments demonstrate that our approach achieves better performance than state-of-the-art baseline methods. • Multi-domain feature alignment can produce higher quality transferable features. • Model dynamic learning can alleviate domain feature alignment overfitting. • We manually labeled a high-quality Chinese intent detection dataset called InDs-CoV. • Extensive experiments demonstrate the superiority and effectiveness of our method. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
09574174
Volume :
255
Database :
Academic Search Index
Journal :
Expert Systems with Applications
Publication Type :
Academic Journal
Accession number :
178942502
Full Text :
https://doi.org/10.1016/j.eswa.2024.124429