1. Multi-task learning using a hybrid representation for text classification
- Author
-
Bo Li, Jiangzhang Gan, Xishun Zhao, Luo Zhiping, Guangquan Lu, and Jian Yin
- Subjects
0209 industrial biotechnology ,Artificial neural network ,business.industry ,Computer science ,Multi-task learning ,02 engineering and technology ,Machine learning ,computer.software_genre ,Convolutional neural network ,Task (computing) ,020901 industrial engineering & automation ,Artificial Intelligence ,0202 electrical engineering, electronic engineering, information engineering ,Feature (machine learning) ,020201 artificial intelligence & image processing ,Artificial intelligence ,Representation (mathematics) ,business ,Joint (audio engineering) ,computer ,Software - Abstract
Text classification is an important task in machine learning. Specifically, deep neural network has been shown strong capability to improve performance in different fields, for example speech recognition, objects recognition and natural language processing. However, in most previous work, the extracted feature models do not achieve the relative text tasks well. To address this issue, we introduce a novel multi-task learning approach called a hybrid representation-learning network for text classification tasks. Our method consists of two network components: a bidirectional gated recurrent unit with attention network module and a convolutional neural network module. In particular, the attention module allows for the task learning private feature representation in local dependence from training texts and that the convolutional neural network module can learn the global representation on sharing. Experiments on 16 subsets of Amazon review data show that our method outperforms several baselines and also proves the effectiveness of joint learning multi-relative tasks.
- Published
- 2018