Back to Search
Start Over
LA-HCN: Label-based Attention for Hierarchical Multi-label Text Classification Neural Network
- Source :
- Expert Systems with Applications. 187:115922
- Publication Year :
- 2022
- Publisher :
- Elsevier BV, 2022.
-
Abstract
- Hierarchical multi-label text classification (HMTC) has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely focus on the design of classifiers, such as the local, global, or a combination of them. However, very few studies have focused on hierarchical feature extraction and explore the association between the hierarchical labels and the text. In this paper, we propose a Label-based Attention for Hierarchical Multi-label Text Classification Neural Network (LA-HCN), where the novel label-based attention module is designed to hierarchically extract important information from the text based on the labels from different hierarchy levels. Besides, hierarchical information is shared across levels while preserving the hierarchical label-based information. Separate local and global document embeddings are obtained and used to facilitate the respective local and global classifications. In our experiments, LA-HCN outperforms other state-of-the-art neural network-based HMTC algorithms on four public HMTC datasets. The ablation study also demonstrates the effectiveness of the proposed label-based attention module as well as the novel local and global embeddings and classifications. By visualizing the learned attention (words), we find that LA-HCN is able to extract meaningful information corresponding to the different labels which provides explainability that may be helpful for the human analyst. National Research Foundation (NRF) This research/project is supported by the National Research Foundation, Singapore under its AI Singapore Programme (AISG Award No: AISG-100E-2019-031).
- Subjects :
- Focus (computing)
Hierarchy (mathematics)
Artificial neural network
Computer science
business.industry
Association (object-oriented programming)
Feature extraction
General Engineering
Deep Neural Network
Machine learning
computer.software_genre
Popularity
Computer Science Applications
ComputingMethodologies_PATTERNRECOGNITION
Artificial Intelligence
Electrical and electronic engineering [Engineering]
Attention
Artificial intelligence
business
computer
Subjects
Details
- ISSN :
- 09574174
- Volume :
- 187
- Database :
- OpenAIRE
- Journal :
- Expert Systems with Applications
- Accession number :
- edsair.doi.dedup.....bf5ae4abe403dc0f987404307fdececf