Micro-expression recognition based on differential feature fusion.

Micro-expressions (MEs) are natural facial mechanisms with short duration and subtle changes. It has attracted much attention in the real world due to its accuracy and uncontrollability of mental expression. With the development of computer vision, micro-expression Recognition (MER) methods have been continuously proposed and improved by scholars. However, the existing MER methods still have some deficiencies in processing Spatio-temporal redundant information and feature extraction. This paper proposes an MER network based on Differential Feature Fusion (DFF) method to solve this problem. First, inputs the onset frame and apex frame of the face, divide each image into small blocks, and uses part of the SE-ResNet50 model for feature extraction. Second, the Spatio-Temporal information of the features is extracted by using a DFF module composed of a differential feature module, CapsuleNet, and a Fully Connected (FC) layer. Finally, inputs the feature vector to the FC module for classification. This study is based on the Leave One Subject Out (LOSO) cross-validation protocol and uses the CASMEII dataset. Experiments and comparisons show the effectiveness of the algorithm. [ABSTRACT FROM AUTHOR]