Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

被引:0
|
作者
Gu, Hanqing [1 ,2 ]
Chen, Jiayin [1 ]
Xiao, Fusu [1 ]
Zhang, Yi-Jia [1 ]
Lu, Zhe-Ming [2 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Mat Sci & Engn, Hangzhou 330114, Peoples R China
[2] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310000, Peoples R China
关键词
Face anti-spoofing; convolutional neural networks; self-attention; integration; multi-modal; PRESENTATION ATTACK DETECTION;
D O I
10.1109/ACCESS.2023.3335040
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Face features, as the most widely adopted and essential biometric characteristic in identity verification and recognition, play a crucial role in ensuring security. However, the significance is also accompanied by various face attacks, posing a great threat to the security of facial recognition systems. Therefore, exploring face anti-spoofing detection holds substantial practical significance. There is existing research on Face Anti-Spoofing (FAS) detection, but there is still potential for enhancing detection performance. In this paper, we propose a face anti-spoofing method, named AR-MLP (Attention ResNet-Multilayer Perceptron), which incorporates self-attention and MLP auxiliary convolution. By replacing the last two "Basic block" layers of the Conv-MLP network with a model combining self-attention and convolution, and adjusting the network architecture and parameters, AR-MLP can capture global features more effectively by suitably integrating the self-attention and convolution layers. We conduct comprehensive evaluations using three authoritative multimodal face anti-spoofing datasets (WMCA, HQ-WMCA, and CASIA-SURF CeFA) for intra-dataset, cross-attack, and cross-race testing. The experimental results demonstrate that AR-MLP outperforms several excellent methods in terms of classification performance and computational overhead.
引用
收藏
页码:131152 / 131167
页数:16
相关论文
共 50 条
  • [1] Conv-MLP: A Convolution and MLP Mixed Model for Multimodal Face Anti-Spoofing
    Wang, Weihang
    Wen, Fei
    Zheng, Haoyuan
    Ying, Rendong
    Liu, Peilin
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 2284 - 2297
  • [2] Self-Attention Generative Distribution Adversarial Network for Few- and Zero-Shot Face Anti-Spoofing
    Son Minh Nguyen
    Linh Duy Tran
    Le, Duc Viet
    Masayuki, Arai
    [J]. 2022 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), 2022,
  • [3] Fine-grained Face Anti-Spoofing based on Recursive Self-Attention and Multi-Scale Fusion
    Xie, Shichuang
    Wu, Jiasheng
    Chen, Yanli
    Han, Meng
    Wu, Ting
    Qiao, Tong
    [J]. 2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1435 - 1442
  • [4] Multiscale residual gradient attention for face anti-spoofing✩
    Zhu, Shiwei
    Xiang, Shijun
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [5] Directional Difference Convolution and Its Application on Face Anti-Spoofing
    Yang, Mingye
    Li, Xian
    Zhao, Dongjie
    Li, Yan
    [J]. MATHEMATICS, 2022, 10 (03)
  • [6] Dynamic Attention based Domain Generalization for Face Anti-Spoofing
    Zhang, Sheng
    Gao, Zhibin
    Lin, Yunhao
    Lu, Yuhang
    Huang, Lianfen
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3413 - 3421
  • [7] DANet: Dynamic Attention to Spoof Patterns for Face Anti-Spoofing
    Sun, Chun-Yu
    Chen, Song-Lu
    Li, Xin-Jie
    Chen, Feng
    Yin, Xu-Cheng
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1929 - 1936
  • [8] Self-Domain Adaptation for Face Anti-Spoofing
    Wang, Jingjing
    Zhang, Jingyi
    Bian, Ying
    Cai, Youyi
    Wang, Chunmao
    Pu, Shiliang
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2746 - 2754
  • [9] Face anti-spoofing methods
    Parveen, Sajida
    Ahmad, Sharifah Mumtazah Syed
    Hanafi, Marsyita
    Adnan, Wan Azizun Wan
    [J]. CURRENT SCIENCE, 2015, 108 (08): : 1491 - 1500
  • [10] Surveillance Face Anti-Spoofing
    Fang, Hao
    Liu, Ajian
    Wan, Jun
    Escalera, Sergio
    Zhao, Chenxu
    Zhang, Xu
    Li, Stan Z.
    Lei, Zhen
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 1535 - 1546