DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition

被引:0
|
作者
Zhao, Sirui [1 ,2 ]
Tang, Huaying [1 ,3 ]
Mao, Xinglong [3 ]
Liu, Shifeng [3 ]
Zhang, Yiming [3 ]
Wang, Hao [3 ]
Xu, Tong [3 ]
Chen, Enhong [3 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[3] Univ Sci & Technol China, Sch Data Sci, Hefei 230027, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Databases; Videos; Psychology; Face recognition; Computer science; Spatiotemporal phenomena; Representation learning; Emotion recognition; facial micro-expression; facial action units; micro-expression recognition; databases; OPTICAL-FLOW; INFORMATION;
D O I
10.1109/TAFFC.2023.3341918
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most important subconscious reactions, micro-expression (ME), is a spontaneous, subtle, and transient facial expression that reveals human beings' genuine emotion. Therefore, automatically recognizing ME (MER) is becoming increasingly crucial in the field of affective computing, providing essential technical support for lie detection, clinical psychological diagnosis, and public safety. However, the ME data scarcity has severely hindered the development of advanced data-driven MER models. Despite the recent efforts by several spontaneous ME databases to alleviate this problem, there is still a lack of sufficient data. Hence, in this paper, we overcome the ME data scarcity problem by collecting and annotating a dynamic spontaneous ME database with the largest current ME data scale called DFME (Dynamic Facial Micro-expressions). Specifically, the DFME database contains 7,526 well-labeled ME videos spanning multiple high frame rates, elicited by 671 participants and annotated by more than 20 professional annotators over three years. Furthermore, we comprehensively verify the created DFME, including using influential spatiotemporal video feature learning models and MER models as baselines, and conduct emotion classification and ME action unit classification experiments. The experimental results demonstrate that the DFME database can facilitate research in automatic MER, and provide a new benchmark for this field.
引用
收藏
页码:1371 / 1386
页数:16
相关论文
共 50 条
  • [31] Adaptive Mask for Region-based Facial Micro-Expression Recognition
    Merghani, Walied
    Yap, Moi Hoon
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 765 - 770
  • [32] Multimodal Fusion-based Swin Transformer for Facial Recognition Micro-Expression Recognition
    Zhao, Xinhua
    Lv, Yongjia
    Huang, Zheng
    PROCEEDINGS OF 2022 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (IEEE ICMA 2022), 2022, : 780 - 785
  • [33] LAENet for micro-expression recognition
    Y. S. Gan
    Sung-En Lien
    Yi-Chen Chiang
    Sze-Teng Liong
    The Visual Computer, 2024, 40 (2) : 585 - 599
  • [34] Seeking Salient Facial Regions for Cross-Database Micro-Expression Recognition
    Jiang, Xingxun
    Zong, Yuan
    Zheng, Wenming
    Liu, Jiateng
    Wei, Mengting
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 1019 - 1025
  • [35] Facial Micro-Expression Recognition in Video using Squeezed Landmark Feature Maps
    Kim, Nayeon
    Cho, Sukhee
    Ahn, Chung Hyun
    Bae, Byungjun
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 1107 - 1110
  • [36] Micro-attention for micro-expression recognition
    Wang, Chongyang
    Peng, Min
    Bi, Tao
    Chen, Tong
    NEUROCOMPUTING, 2020, 410 : 354 - 362
  • [37] Micron-BERT: BERT-based Facial Micro-Expression Recognition
    Nguyen, Xuan-Bac
    Duong, Chi Nhan
    Li, Xin
    Gauch, Susan
    Seo, Han-Seok
    Luu, Khoa
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1482 - 1492
  • [38] Deep Convolutional Neural Network with Optical Flow for Facial Micro-Expression Recognition
    Li, Qiuyu
    Yu, Jun
    Kurihara, Toru
    Zhang, Haiyan
    Zhan, Shu
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (01)
  • [39] Facial Micro-Expression Recognition Based on Deep Local-Holistic Network
    Li, Jingting
    Wang, Ting
    Wang, Su-Jing
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [40] Research on Automatic Music Recommendation Algorithm Based on Facial Micro-expression Recognition
    Yu, Ziyang
    Zhao, Mengda
    Wu, Yilin
    Liu, Peizhuo
    Chen, Hexu
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7257 - 7263