基于空洞单流 ViT 网络的灵活模态 人脸呈现攻击检测方法.

Flexible modal face presentation attack detection can break through the limitations of traditional multi-modal methods on modal consistency in model training and deployment, and it can deploy the unified model flexibly to real scenarios of multiple modals on demand. However, there are still issues with improved model performance and high demand for computing resources. Therefore, this paper proposes a single stream flexible modal face presentation attack detection network based on Vision Transformer. Furthermore, this paper proposes the atrous patch embedding module to address the operational redundancy problem and reduce the input vector dimension, designs the modal encoding token to distinguish different modal features, and adopts a non-padding strategy to solve the modal absence problem essentially. The experimental results on publicly available multi-modal datasets show that the method proposed in this paper can obtain the best ACER averages of 2.69% and 33.81% in the intra-domain and cross-domain evaluations,respectively, and has excellent in-domain and out-of-domain generalization performance, and balanced performance across different sub-protocols compared to the existing three methods. It significantly reduces the quantities of calculations and parameters compared with multi-stream methods, and is more suitable for flexible and efficient deployment in modal absence scenarios. [ABSTRACT FROM AUTHOR]