1. 基于自适应学习的序列生成方法.
- Author
-
张宝奇, 赵书良, 张 剑, and 吕晓锋
- Subjects
- *
DATA distribution , *DEEP learning , *MACHINE learning - Abstract
Discrete sequence generation is widely used in text generation, sequence recommendation and other fields. The current research work mainly focuses on improving the accuracy of sequence generation, but ignores the diversity of generation. To address this phenomenon, this paper proposed an adaptive sequence generation method ( ECoT), and designed a two-layer meta controller. In the data layer, the function of meta controller was to realize adaptive learning sampling, automatically balance the distribution of real data and generated data,and obtain mixed data distribution. At the model level, this paper added diversity constraints. The function of the meta controller was to adaptively learn the optimal update gradient to improve the generation diversity of the generation model. In addition, in order to improve the accuracy of the generation model, this paper proposed a method combining cooperative training and adversarial learning. Compared with the current mainstream models, the results show that the adaptive cooperative training sequence generation method has more balanced accuracy and diversity in terms of generation accuracy and diversity, and can effectively alleviate the pattern collapse of the generation model. [ABSTRACT FROM AUTHOR]
- Published
- 2022
- Full Text
- View/download PDF