1. DeMaskGAN: a de-masking generative adversarial network guided by semantic segmentation.
- Author
-
Ye, Zixun, Zhang, Hongying, Li, Xue, and Zhang, Qin
- Subjects
- *
GENERATIVE adversarial networks , *HUMAN facial recognition software , *DATA augmentation - Abstract
To address the problem of reduced face recognition accuracy in masked scenarios, this paper proposes a masked face reconstruction algorithm DeMaskGAN, which uses the Transformer Reconstruction Head (TRH) to restore the masked face features, and uses the Transformer Segmentation Head as an aid so that the TRH focuses on the masked face region and reconstructs the face to an unmasked state while maintaining the identity information. To improve the model performance, identity consistency, key point consistency, and perceptual consistency supervision mechanisms for faces are proposed to assist in training the model, and data augmentation methods are used to generate Mask-FFHQ datasets adapted to the mask-obscured face segmentation and reconstruction tasks, the experimental results show that the reconstructed face images enable the face recognition algorithm MobileFaceNet to achieve an AUC metric of 0.9743, which is 0.039 better than the direct use of MobileFaceNet to recognize masked faces. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF