CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition

被引:172
|
作者
Qu, Fangbing [1 ,2 ,3 ]
Wang, Su-Jing [4 ]
Yan, Wen-Jing [5 ]
Li, He [1 ,2 ]
Wu, Shuhang [6 ]
Fu, Xiaolan [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Capital Normal Univ, Coll Presch Educ, Beijing 100048, Peoples R China
[4] Inst Psychol, CAS Key Lab Behav Sci, Beijing 100101, Peoples R China
[5] Wenzhou Univ, Coll Teacher Educ, Wenzhou 325035, Peoples R China
[6] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Liaoning, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Macro-expression and micro-expression spotting; macro-expression and micro-expression recognition; micro-expression database; facial action coding system; MODELS;
D O I
10.1109/TAFFC.2017.2654440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deception is a very common phenomenon and its detection can be beneficial to our daily lives. Compared with other deception cues, micro-expression has shown great potential as a promising cue for deception detection. The spotting and recognition of micro-expression from long videos may significantly aid both law enforcement officers and researchers. However, database that contains both micro-expression and macro-expression in long videos is still not publicly available. To facilitate development in this field, we present a new database, Chinese Academy of Sciences Macro-Expressions and Micro-Expressions (CAS(ME)(2)), which provides both macro-expressions and micro-expressions in two parts (A and B). Part A contains 87 long videos that contain spontaneous macro-expressions and micro-expressions. Part B includes 300 cropped spontaneous macro-expression samples and 57 micro-expression samples. The emotion labels are based on a combination of action units (AUs), self-reported emotion for every facial movement, and the emotion types of emotion-evoking videos. Local Binary Pattern (LBP) was employed for the spotting and recognition of macro-expressions and micro-expressions and the results were reported as a baseline evaluation. The CAS(ME)(2) database offers both long videos and cropped expression samples, which may aid researchers in developing efficient algorithms for the spotting and recognition of macro-expressions and micro-expressions.
引用
收藏
页码:424 / 436
页数:13
相关论文
共 50 条
  • [1] Learning from Macro-expression: a Micro-expression Recognition Framework
    Xia, Bin
    Wang, Weikang
    Wang, Shangfei
    Chen, Enhong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2936 - 2944
  • [2] Micro-Expression Recognition Enhanced by Macro-Expression from Spatial-Temporal Domain
    Xia, Bin
    Wang, Shangfei
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 1186 - 1193
  • [3] EEG-based emotion recognition from macro-expression and micro-expression studies
    Shen, Xunbing
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 2023, 58 : 235 - 236
  • [4] Automatic Apex Frame Spotting in Micro-expression Database
    Liong, Sze-Teng
    See, John
    Wong, KokSheik
    Anh Cat Le Ngo
    Oh, Yee-Hui
    Phan, Raphael
    PROCEEDINGS 3RD IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION ACPR 2015, 2015, : 665 - 669
  • [5] For micro-expression recognition: Database and suggestions
    Yan, Wen-Jing
    Wang, Su-Jing
    Liu, Yong-Jin
    Wu, Qi
    Fu, Xiaolan
    NEUROCOMPUTING, 2014, 136 : 82 - 87
  • [6] Review of micro-expression spotting and recognition in video sequences
    Hang PAN
    Lun XIE
    Zhiliang WANG
    Bin LIU
    Minghao YANG
    Jianhua TAO
    虚拟现实与智能硬件(中英文), 2021, 3 (01) : 1 - 17
  • [7] Review of micro-expression spotting and recognition in video sequences
    Pan H.
    Xie L.
    Wang Z.
    Liu B.
    Yang M.
    Tao J.
    Virtual Reality and Intelligent Hardware, 2021, 3 (01): : 1 - 17
  • [8] ABPN: Apex and Boundary Perception Network for Micro- and Macro-Expression Spotting
    Leng, Wenhao
    Zhao, Sirui
    Zhang, Yiming
    Liu, Shifeng
    Mao, Xinglong
    Wang, Hao
    Xu, Tong
    Chen, Enhong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7160 - 7164
  • [9] Spontaneous micro-expression spotting via geometric deformation modeling
    Xia, Zhaoqiang
    Feng, Xiaoyi
    Peng, Jinye
    Peng, Xianlin
    Zhao, Guoying
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 147 : 87 - 94
  • [10] Can Expression Sensitivity Improve Macro- and Micro-Expression Spotting in Long Videos?
    Bai, Mengjiong
    Goecke, Roland
    PROCEEDINGS OF THE 2ND INTERNATIONAL WORKSHOP ON MULTIMODAL AND RESPONSIBLE AFFECTIVE COMPUTING, MRAC 2024, 2024, : 30 - 38