Back to Search Start Over

Application of Quantum Recurrent Neural Network in Low-Resource Language Text Classification

Authors :
Wenbin Yu
Lei Yin
Chengjun Zhang
Yadang Chen
Alex X. Liu
Source :
IEEE Transactions on Quantum Engineering, Vol 5, Pp 1-13 (2024)
Publication Year :
2024
Publisher :
IEEE, 2024.

Abstract

Text sentiment analysis is an important task in natural language processing and has always been a hot research topic. However, in low-resource regions such as South Asia, where languages like Bengali are widely used, the research interest is relatively low compared to high-resource regions due to limited computational resources, flexible word order, and high inflectional nature of the language. With the development of quantum technology, quantum machine learning models leverage the superposition property of qubits to enhance model expressiveness and achieve faster computation compared to classical systems. To promote the development of quantum machine learning in low-resource language domains, we propose a quantum–classical hybrid architecture. This architecture utilizes a pretrained multilingual bidirectional encoder representations from transformer (BERT) model to obtain vector representations of words and combines the proposed batch upload quantum recurrent neural network (BUQRNN) and parameter nonshared batch upload quantum recurrent neural network (PN-BUQRNN) as feature extraction models for sentiment analysis in Bengali. Our numerical results demonstrate that the proposed BUQRNN structure achieves a maximum accuracy improvement of 0.993% in Bengali text classification tasks while reducing average model complexity by 12%. The PN-BUQRNN structure surpasses the BUQRNN structure once again and outperforms classical architectures in certain tasks.

Details

Language :
English
ISSN :
26891808
Volume :
5
Database :
Directory of Open Access Journals
Journal :
IEEE Transactions on Quantum Engineering
Publication Type :
Academic Journal
Accession number :
edsdoj.742eb2f0e7ba4468ab35fe3fb84d4cf3
Document Type :
article
Full Text :
https://doi.org/10.1109/TQE.2024.3373903