1. Nonlinear process modeling via unidimensional convolutional neural networks with self-attention on global and local inter-variable structures and its application to process monitoring
- Author
-
Shipeng Li, Yueming Hu, and Jiaxiang Luo
- Subjects
0209 industrial biotechnology ,Process modeling ,Computer science ,Intelligence ,02 engineering and technology ,computer.software_genre ,Convolutional neural network ,020901 industrial engineering & automation ,0202 electrical engineering, electronic engineering, information engineering ,Electrical and Electronic Engineering ,Representation (mathematics) ,Instrumentation ,Applied Mathematics ,Dynamic data ,020208 electrical & electronic engineering ,Process (computing) ,Computer Science Applications ,Nonlinear system ,Variable (computer science) ,Identification (information) ,Nonlinear Dynamics ,Control and Systems Engineering ,Neural Networks, Computer ,Data mining ,computer ,Algorithms ,Software - Abstract
Nonlinear process modeling is a primary task in intelligent manufacturing, aiming at extracting high-value features from massive process data for further process analysis like process monitoring. However, it is still a challenge to develop nonlinear process models with robust representation capability for diverse process faults. From the new perspective of the correlation between process variables, this paper develops a nonlinear process modeling algorithm to adaptively preserve the features of both global and local inter-variable structures, in order to fully exploit inter-variable features for enhancing the nonlinear representation of process operating conditions. Specifically, a unidimensional convolutional operation with a self-attention mechanism is proposed to simultaneously extract global and local inter-variable structures, wherein different attentions can be adaptively adjusted to these two structures for the final aggregation of them. Besides, cooperating with a two-dimensional dynamic data extension, the unidimensional convolutional operation can represent the overall temporal relationship between process samples. Through stacking a collection of these convolutional operations, a ResNet-style convolutional neural network then is constructed to extract high-order nonlinear features. Experiments on the Tennessee Eastman process validate the effectiveness of the proposed algorithm for two vital process monitoring problems-fault detection and fault identification.
- Published
- 2022