CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition

被引:172
|
作者
Qu, Fangbing [1 ,2 ,3 ]
Wang, Su-Jing [4 ]
Yan, Wen-Jing [5 ]
Li, He [1 ,2 ]
Wu, Shuhang [6 ]
Fu, Xiaolan [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Capital Normal Univ, Coll Presch Educ, Beijing 100048, Peoples R China
[4] Inst Psychol, CAS Key Lab Behav Sci, Beijing 100101, Peoples R China
[5] Wenzhou Univ, Coll Teacher Educ, Wenzhou 325035, Peoples R China
[6] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Liaoning, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Macro-expression and micro-expression spotting; macro-expression and micro-expression recognition; micro-expression database; facial action coding system; MODELS;
D O I
10.1109/TAFFC.2017.2654440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deception is a very common phenomenon and its detection can be beneficial to our daily lives. Compared with other deception cues, micro-expression has shown great potential as a promising cue for deception detection. The spotting and recognition of micro-expression from long videos may significantly aid both law enforcement officers and researchers. However, database that contains both micro-expression and macro-expression in long videos is still not publicly available. To facilitate development in this field, we present a new database, Chinese Academy of Sciences Macro-Expressions and Micro-Expressions (CAS(ME)(2)), which provides both macro-expressions and micro-expressions in two parts (A and B). Part A contains 87 long videos that contain spontaneous macro-expressions and micro-expressions. Part B includes 300 cropped spontaneous macro-expression samples and 57 micro-expression samples. The emotion labels are based on a combination of action units (AUs), self-reported emotion for every facial movement, and the emotion types of emotion-evoking videos. Local Binary Pattern (LBP) was employed for the spotting and recognition of macro-expressions and micro-expressions and the results were reported as a baseline evaluation. The CAS(ME)(2) database offers both long videos and cropped expression samples, which may aid researchers in developing efficient algorithms for the spotting and recognition of macro-expressions and micro-expressions.
引用
收藏
页码:424 / 436
页数:13
相关论文
共 50 条
  • [21] Spatiotemporal features selection for spontaneous micro-expression recognition
    Yu, Yang
    Duan, Huiyan
    Yu, Ming
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (04) : 4773 - 4784
  • [22] LGSNet: A Two-Stream Network for Micro- and Macro-Expression Spotting With Background Modeling
    Yu, Wang-Wang
    Jiang, Jingwen
    Yang, Kai-Fu
    Yan, Hong-Mei
    Li, Yong-Jie
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (01) : 223 - 240
  • [23] Micro-Expression Spotting Using Facial Landmarks
    Beh, Kai Xin
    Goh, Kam Meng
    2019 IEEE 15TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING & ITS APPLICATIONS (CSPA 2019), 2019, : 192 - 197
  • [24] Micro-Expression Spotting using the Riesz Pyramid
    Duque, Carlos Arango
    Alata, Olivier
    Emonet, Remi
    Legrand, Anne-Claire
    Konik, Hubert
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 66 - 74
  • [25] A review of micro-expression spotting: methods and challenges
    Zhang, He
    Yin, Lu
    Zhang, Hanling
    MULTIMEDIA SYSTEMS, 2023, 29 (04) : 1897 - 1915
  • [26] A review of micro-expression spotting: methods and challenges
    He Zhang
    Lu Yin
    Hanling Zhang
    Multimedia Systems, 2023, 29 : 1897 - 1915
  • [27] AU-aware graph convolutional network for Macro- and Micro-expression spotting
    Yin, Shukang
    Wu, Shiwei
    Xu, Tong
    Liu, Shifeng
    Zhao, Sirui
    Chen, Enhong
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 228 - 233
  • [28] Apex Frame Spotting Using Attention Networks for Micro-Expression Recognition System
    Yee, Ng Lai
    Zulkifley, Mohd Asyraf
    Saputro, Adhi Harmoko
    Abdani, Siti Raihanah
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5331 - 5348
  • [29] Domain Regeneration for Cross-Database Micro-Expression Recognition
    Zong, Yuan
    Zheng, Wenming
    Huang, Xiaohua
    Shi, Jingang
    Cui, Zhen
    Zhao, Guoying
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (05) : 2484 - 2498
  • [30] HTNet for micro-expression recognition
    Wang, Zhifeng
    Zhang, Kaihao
    Luo, Wenhan
    Sankaranarayana, Ramesh
    NEUROCOMPUTING, 2024, 602