Search

This paper has the aim of solving problems in research studies on the analysis tasks of text emotion; the problems are the low utilization of text, the difficulty of effective information extraction, the failure of recognizing word polysemy with effectiveness. Thus, based on LSTM and Bert, the method of sentiment analysis on text is adopted. To be precise, word embedding of dataset in view of the skip-gram model is used for training course. In each sample, the word embeddings combine matric with the two-dimensional feature to be neural network input. Next, construction of analysis model for text sentiment combines Bert pre-training language model and long short-term memory (LSTM) network, using the word vector pre-trained by Bert instead of that trained in the traditional way to dynamically generate the semantic vector according to the word context. Finally, the semantic representation of words from text is improved by effectively identifying the polysemy of words, and the semantic vector is input into the LSTM to capture the semantic dependencies, thereby enhancing the ability to extract valid information. The Accuracy, Precision, Recall and F-Measure for the method of Bert–LSTM based on analysis of text sentiment are 0.89, 0.9, 0.84 and 0.87, indicating high value than the compared ones. Thus, the proposed method significantly outperforms the comparison methods in text sentiment analysis. [ABSTRACT FROM AUTHOR]

Aiming at the problem of low accuracy rate of current sentiment analysis methods for book review texts, a book review sentiment analysis method based on BERT-ABiLSTM hybrid model is proposed. First, the overall framework of sentiment analysis is constructed by integrating sentiment vocabulary and deep learning methods, and the fine-grained sentiment analysis is divided into three stages: topic identification, sentiment identification and thematic sentiment identification. Then, a dynamic character-level word vector containing contextual information is generated using a bidirectional encoder representation from transformers (BERT) pre-trained language model. Then, the contextual information in the text data is fully learned by introducing the bidirectional long short-term memory (BiLSTM) model. Finally, the accurate analysis of book review sentiment is achieved by using Attention mechanism to highlight important features and improve the efficiency of resource utilization. Through an experimental comparison with existing advanced algorithms, the proposed method in this study has improved at least 4.2%, 3.9% and 3.79% in precision, recall and F1 values, respectively. The experimental results show that the proposed BERT-ABiLSTM is higher than the existing models under different metrics, indicating that the proposed model has a good application prospect in the fields of book review analysis and book recommendation. [ABSTRACT FROM AUTHOR]