Back to Search Start Over

A Novel Variant of LSTM Stock Prediction Method Incorporating Attention Mechanism

Authors :
Shuai Sang
Lu Li
Source :
Mathematics, Vol 12, Iss 7, p 945 (2024)
Publication Year :
2024
Publisher :
MDPI AG, 2024.

Abstract

Long Short-Term Memory (LSTM) is an effective method for stock price prediction. However, due to the nonlinear and highly random nature of stock price fluctuations over time, LSTM exhibits poor stability and is prone to overfitting, resulting in low prediction accuracy. To address this issue, this paper proposes a novel variant of LSTM that couples the forget gate and input gate in the LSTM structure, and adds a “simple” forget gate to the long-term cell state. In order to enhance the generalization ability and robustness of the variant LSTM, the paper introduces an attention mechanism and combines it with the variant LSTM, presenting the Attention Mechanism Variant LSTM (AMV-LSTM) model along with the corresponding backpropagation algorithm. The parameters in AMV-LSTM are updated using the Adam gradient descent method. Experimental results demonstrate that the variant LSTM alleviates the instability and overfitting issues of LSTM, effectively improving prediction accuracy. AMV-LSTM further enhances accuracy compared to the variant LSTM, and compared to AM-LSTM, it exhibits superior generalization ability, accuracy, and convergence capability.

Details

Language :
English
ISSN :
22277390
Volume :
12
Issue :
7
Database :
Directory of Open Access Journals
Journal :
Mathematics
Publication Type :
Academic Journal
Accession number :
edsdoj.037e28db8a024754be82838eb0c692c5
Document Type :
article
Full Text :
https://doi.org/10.3390/math12070945