DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition

被引:0
|
作者
Zhao, Sirui [1 ,2 ]
Tang, Huaying [1 ,3 ]
Mao, Xinglong [3 ]
Liu, Shifeng [3 ]
Zhang, Yiming [3 ]
Wang, Hao [3 ]
Xu, Tong [3 ]
Chen, Enhong [3 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[3] Univ Sci & Technol China, Sch Data Sci, Hefei 230027, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Databases; Videos; Psychology; Face recognition; Computer science; Spatiotemporal phenomena; Representation learning; Emotion recognition; facial micro-expression; facial action units; micro-expression recognition; databases; OPTICAL-FLOW; INFORMATION;
D O I
10.1109/TAFFC.2023.3341918
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most important subconscious reactions, micro-expression (ME), is a spontaneous, subtle, and transient facial expression that reveals human beings' genuine emotion. Therefore, automatically recognizing ME (MER) is becoming increasingly crucial in the field of affective computing, providing essential technical support for lie detection, clinical psychological diagnosis, and public safety. However, the ME data scarcity has severely hindered the development of advanced data-driven MER models. Despite the recent efforts by several spontaneous ME databases to alleviate this problem, there is still a lack of sufficient data. Hence, in this paper, we overcome the ME data scarcity problem by collecting and annotating a dynamic spontaneous ME database with the largest current ME data scale called DFME (Dynamic Facial Micro-expressions). Specifically, the DFME database contains 7,526 well-labeled ME videos spanning multiple high frame rates, elicited by 671 participants and annotated by more than 20 professional annotators over three years. Furthermore, we comprehensively verify the created DFME, including using influential spatiotemporal video feature learning models and MER models as baselines, and conduct emotion classification and ME action unit classification experiments. The experimental results demonstrate that the DFME database can facilitate research in automatic MER, and provide a new benchmark for this field.
引用
收藏
页码:1371 / 1386
页数:16
相关论文
共 50 条
  • [41] ME-TSRN for Thermal Sensation Recognition via Facial Micro-expression
    Zhao, Xinhui
    Tang, Kai
    Ouchi, Kazushige
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 83 - 88
  • [42] Facial Micro-Expression Recognition Using Quaternion-Based Sparse Representation
    Yang, Hang
    Wang, Qingshan
    Wang, Qi
    Liu, Peng
    Huang, Wei
    2020 29TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATIONS AND NETWORKS (ICCCN 2020), 2020,
  • [43] Late Fusion-Based Video Transformer for Facial Micro-Expression Recognition
    Hong, Jiuk
    Lee, Chaehyeon
    Jung, Heechul
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [44] Thermoacoustic environment comfort evaluation method based on facial micro-expression recognition
    Hu, Songtao
    Sun, Jie
    Zhang, Jun
    Liu, Guodan
    Zhao, Shipeng
    BUILDING AND ENVIRONMENT, 2022, 221
  • [45] Micro-expression Recognition Based on Facial Graph Representation Learning and Facial Action Unit Fusion
    Lei, Ling
    Chen, Tong
    Li, Shigang
    Li, Jianfeng
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 1571 - 1580
  • [46] Micro-expression recognition based on facial action learning with muscle movement constraints
    Cen, Shixin
    Yu, Yang
    Yan, Gang
    Yu, Ming
    Kong, Yanlei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (02) : 2905 - 2921
  • [47] Facial micro-expression recognition method based on CNN and transformer mixed model
    Tang, Yi
    Yi, Jiaojun
    Tan, Feigang
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2024, 16 (05) : 463 - 477
  • [48] Sliding Window Based Micro-expression Spotting: A Benchmark
    Thuong-Khanh Tran
    Hong, Xiaopeng
    Zhao, Guoying
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS (ACIVS 2017), 2017, 10617 : 542 - 553
  • [49] Investigating LSTM for Micro-Expression Recognition
    Bai, Mengjiong
    Goecke, Roland
    COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 7 - 11
  • [50] To balance: balanced micro-expression recognition
    Zhang, Ren
    He, Ning
    Wu, Ying
    He, Yuzhe
    Yan, Kang
    MULTIMEDIA SYSTEMS, 2022, 28 (01) : 335 - 345