Search

Remaining Useful Life (RUL) prediction is of great significance for maintaining the reliability and safety of industrial equipment. To address the challenges faced by existing methods in simultaneously extracting local and global degradation information from monitoring data. This paper proposes a Two-Stream Convolution Augmented Transformer (TACT) model based on L 2 regularization constraint. Specifically, we design the parallel multi-scale Convolution Neural Network (CNN) and Transformer module to combine the local modeling ability of CNN and the global modeling ability of Transformer to improve the overall architecture of RUL prediction model. Moreover, the two-stream network based on the parallel structure also realizes the synchronous extraction of different time steps and sensor features in the sequence. Then, in the process of model training, the prediction reliability constraint is fused, the delay prediction constraint term is introduced, and the L 2 regularization loss function is constructed. Finally, extensive experiments on the commercial modular aero-propulsion system simulation (C-MAPSS) show that our model provides competitive performance in terms of Root-Mean-Square Error (RMSE) and Score metrics. Compared to the state-of-the-art method based on Recurrent Neural Network (RNN) or CNN and its variants, Score is reduced by at least 2.71% and RMSE by at least 3.13%. Compared to the Transformer-based improved method, the Score is decreased by at least 4.54% and the RMSE is decreased by at least 2.78%. The effectiveness of the proposed method is demonstrated. • A hybrid end-to-end RUL prediction network based on a tandem combination of CNN and Transformer is proposed. • A two-stream structure is used to extract spatial and temporal features simultaneously. • The MSE loss function incorporating L 2 regularization constraint is proposed. [ABSTRACT FROM AUTHOR]

Remaining Useful Life (RUL) prediction is of great significance for maintaining the reliability and safety of industrial equipment. To address the challenges faced by existing methods in simultaneously extracting local and global degradation information from monitoring data. This paper proposes a Two-Stream Convolution Augmented Transformer (TACT) model based on L 2 regularization constraint. Specifically, we design the parallel multi-scale Convolution Neural Network (CNN) and Transformer module to combine the local modeling ability of CNN and the global modeling ability of Transformer to improve the overall architecture of RUL prediction model. Moreover, the two-stream network based on the parallel structure also realizes the synchronous extraction of different time steps and sensor features in the sequence. Then, in the process of model training, the prediction reliability constraint is fused, the delay prediction constraint term is introduced, and the L 2 regularization loss function is constructed. Finally, extensive experiments on the commercial modular aero-propulsion system simulation (C-MAPSS) show that our model provides competitive performance in terms of Root-Mean-Square Error (RMSE) and Score metrics. Compared to the state-of-the-art method based on Recurrent Neural Network (RNN) or CNN and its variants, Score is reduced by at least 2.71% and RMSE by at least 3.13%. Compared to the Transformer-based improved method, the Score is decreased by at least 4.54% and the RMSE is decreased by at least 2.78%. The effectiveness of the proposed method is demonstrated. • A hybrid end-to-end RUL prediction network based on a tandem combination of CNN and Transformer is proposed. • A two-stream structure is used to extract spatial and temporal features simultaneously. • The MSE loss function incorporating L 2 regularization constraint is proposed. [ABSTRACT FROM AUTHOR]

• aircraft engine remaining useful life prediction method with the real engine flight data • multilayered deep convolutional neural network architecture and a long short-term memory network with regression output • comparison of the various deep neural network training options • analysis of the real turbofan engine operational data as an input data for the deep neural network, in order to train, validate and test machine learning algorithms in predicting engine remaining useful life • case studies for method verification based on the real-life engine operational data not the simulated one Aircraft Engine Remaining Useful Life is a key factor which strongly affects flight operations safety and flight operators business decisions. In the article authors decided to present the concept of engine remaining useful life prediction. Proposed method was created as a result of the analysis of the real turbofan engine operational data collected for a few years which was used as an input data for the deep neural network, in order to train, validate and test machine learning algorithms. Two architectures of deep neural networks were created: multilayered deep convolutional neural networks and a long short-term memory network with regression output. Both neural networks were trained, validated and tested on the same engine data and with a various network training options. Results were compared with the neural network performance metrics and figures presenting network prediction convergence. To present how the real-life engine dataset differs the results from the simulated data, both datasets were validated on the same neural network architectures. The main purpose of this article was to present the idea and method of how the artificial neural networks could be used to predict aircraft remaining useful life indicator on the real-life engine operational data not the simulated one. [ABSTRACT FROM AUTHOR]

Remaining useful life (RUL) prediction of aircraft engines is significant in the health monitoring, operation, and maintenance of aircraft. Capturing more comprehensive device degradation trends at different time scales and extracting long-term dependencies effectively among elements in long time series are two challenges in the field of aircraft engine RUL estimation. To address the aforementioned challenges, this paper proposes a novel multiscale Hourglass-Transformer (MHT) aircraft engine RUL prognostics. Specifically, an hourglass-shaped multiscale feature extractor (HME) is designed based on one-dimensional convolutional neural network, which can scale the time sequence into multi-time scales for feature fusion. Then, a transformer network is employed to further extract features from the fused feature map and output the RUL. To enhance inter-scale data attention, a pyramid self-attention mechanism is employed in both the encoder and decoder. Finally, the superiority and effectiveness of this approach are verified on the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) dataset. Furthermore, the robustness and generalization capability of this method are further validated on New Commercial Modular Aero-Propulsion System Simulation (N-CMAPSS) dataset. • A novel multiscale Hourglass-Transformer is developed for aircraft engine RUL prognostics. • An hourglass-shaped multiscale feature extractor is designed based on one-dimensional convolutional neural network. • A transformer network is employed to further extract features. • Pyramid self-attention mechanism is adopted to reduce space complexity. [ABSTRACT FROM AUTHOR]