DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition

被引:0
|
作者
Zhao, Sirui [1 ,2 ]
Tang, Huaying [1 ,3 ]
Mao, Xinglong [3 ]
Liu, Shifeng [3 ]
Zhang, Yiming [3 ]
Wang, Hao [3 ]
Xu, Tong [3 ]
Chen, Enhong [3 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[3] Univ Sci & Technol China, Sch Data Sci, Hefei 230027, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Databases; Videos; Psychology; Face recognition; Computer science; Spatiotemporal phenomena; Representation learning; Emotion recognition; facial micro-expression; facial action units; micro-expression recognition; databases; OPTICAL-FLOW; INFORMATION;
D O I
10.1109/TAFFC.2023.3341918
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most important subconscious reactions, micro-expression (ME), is a spontaneous, subtle, and transient facial expression that reveals human beings' genuine emotion. Therefore, automatically recognizing ME (MER) is becoming increasingly crucial in the field of affective computing, providing essential technical support for lie detection, clinical psychological diagnosis, and public safety. However, the ME data scarcity has severely hindered the development of advanced data-driven MER models. Despite the recent efforts by several spontaneous ME databases to alleviate this problem, there is still a lack of sufficient data. Hence, in this paper, we overcome the ME data scarcity problem by collecting and annotating a dynamic spontaneous ME database with the largest current ME data scale called DFME (Dynamic Facial Micro-expressions). Specifically, the DFME database contains 7,526 well-labeled ME videos spanning multiple high frame rates, elicited by 671 participants and annotated by more than 20 professional annotators over three years. Furthermore, we comprehensively verify the created DFME, including using influential spatiotemporal video feature learning models and MER models as baselines, and conduct emotion classification and ME action unit classification experiments. The experimental results demonstrate that the DFME database can facilitate research in automatic MER, and provide a new benchmark for this field.
引用
收藏
页码:1371 / 1386
页数:16
相关论文
共 50 条
  • [21] DUAL-STREAM SHALLOW NETWORKS FOR FACIAL MICRO-EXPRESSION RECOGNITION
    Khor, Huai-Qian
    See, John
    Liong, Sze-Teng
    Phan, Raphael C. W.
    Lin, Weiyao
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 36 - 40
  • [22] Structure Representation With Adaptive and Compact Facial Graph for Micro-Expression Recognition
    Li, Chunlei
    Ba, Renwei
    Wang, Xueping
    Yu, Miao
    Li, Xiao
    Huang, Di
    IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE, 2025, 7 (02): : 256 - 269
  • [23] Spontaneous Facial Micro-expression Recognition via Deep Convolutional Network
    Xia, Zhaoqiang
    Feng, Xiaoyi
    Hong, Xiaopeng
    Zhao, Guoying
    2018 EIGHTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2018, : 235 - 240
  • [24] Decoupling facial motion features and identity features for micro-expression recognition
    Xie T.
    Sun G.
    Sun H.
    Lin Q.
    Ben X.
    PeerJ Computer Science, 2022, 8
  • [25] HTNet for micro-expression recognition
    Wang, Zhifeng
    Zhang, Kaihao
    Luo, Wenhan
    Sankaranarayana, Ramesh
    NEUROCOMPUTING, 2024, 602
  • [26] A survey of micro-expression recognition
    Zhou, Ling
    Shao, Xiuyan
    Mao, Qirong
    IMAGE AND VISION COMPUTING, 2021, 105
  • [27] Micro-expression recognition system
    Zhang, Peng
    Ben, Xianye
    Yan, Rui
    Wu, Chen
    Guo, Chang
    OPTIK, 2016, 127 (03): : 1395 - 1400
  • [28] LAENet for micro-expression recognition
    Gan, Y. S.
    Lien, Sung-En
    Chiang, Yi-Chen
    Liong, Sze-Teng
    VISUAL COMPUTER, 2024, 40 (02): : 585 - 599
  • [29] CapsuleNet for Micro-Expression Recognition
    Nguyen Van Quang
    Chun, Jinhee
    Tokuyama, Takeshi
    2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, : 635 - 641
  • [30] Decoupling facial motion features and identity features for micro-expression recognition
    Xie, Tingxuan
    Sun, Guoquan
    Sun, Hao
    Lin, Qiang
    Ben, Xianye
    PEERJ COMPUTER SCIENCE, 2022, 8