CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition

被引:172
|
作者
Qu, Fangbing [1 ,2 ,3 ]
Wang, Su-Jing [4 ]
Yan, Wen-Jing [5 ]
Li, He [1 ,2 ]
Wu, Shuhang [6 ]
Fu, Xiaolan [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Capital Normal Univ, Coll Presch Educ, Beijing 100048, Peoples R China
[4] Inst Psychol, CAS Key Lab Behav Sci, Beijing 100101, Peoples R China
[5] Wenzhou Univ, Coll Teacher Educ, Wenzhou 325035, Peoples R China
[6] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Liaoning, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Macro-expression and micro-expression spotting; macro-expression and micro-expression recognition; micro-expression database; facial action coding system; MODELS;
D O I
10.1109/TAFFC.2017.2654440
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deception is a very common phenomenon and its detection can be beneficial to our daily lives. Compared with other deception cues, micro-expression has shown great potential as a promising cue for deception detection. The spotting and recognition of micro-expression from long videos may significantly aid both law enforcement officers and researchers. However, database that contains both micro-expression and macro-expression in long videos is still not publicly available. To facilitate development in this field, we present a new database, Chinese Academy of Sciences Macro-Expressions and Micro-Expressions (CAS(ME)(2)), which provides both macro-expressions and micro-expressions in two parts (A and B). Part A contains 87 long videos that contain spontaneous macro-expressions and micro-expressions. Part B includes 300 cropped spontaneous macro-expression samples and 57 micro-expression samples. The emotion labels are based on a combination of action units (AUs), self-reported emotion for every facial movement, and the emotion types of emotion-evoking videos. Local Binary Pattern (LBP) was employed for the spotting and recognition of macro-expressions and micro-expressions and the results were reported as a baseline evaluation. The CAS(ME)(2) database offers both long videos and cropped expression samples, which may aid researchers in developing efficient algorithms for the spotting and recognition of macro-expressions and micro-expressions.
引用
收藏
页码:424 / 436
页数:13
相关论文
共 50 条
  • [41] Micro-Expression Spotting with Face Alignment and Optical Flow
    Qin, Wenfeng
    Zou, Bochao
    Li, Xin
    Wang, Weiping
    Ma, Huimin
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9501 - 9505
  • [42] Spatio-temporal fusion for Macro- and Micro-expression Spotting in Long Video Sequences
    Zhang, Li-Wei
    Li, Jingting
    Wang, Su-Jing
    Duan, Xian-Hua
    Yan, Wen-Jing
    Xie, Hai-Yong
    Huang, Shu-Cheng
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 734 - 741
  • [43] Sliding Window Based Micro-expression Spotting: A Benchmark
    Thuong-Khanh Tran
    Hong, Xiaopeng
    Zhao, Guoying
    ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS (ACIVS 2017), 2017, 10617 : 542 - 553
  • [44] Rethinking Optical Flow Methods for Micro-Expression Spotting
    Zhao, Yuan
    Tong, Xin
    Zhu, Zichong
    Sheng, Jianda
    Dai, Lei
    Xu, Lingling
    Xia, Xuehai
    Jiang, Yu
    Li, Jiao
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7175 - 7179
  • [45] CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline Evaluation
    Yan, Wen-Jing
    Li, Xiaobai
    Wang, Su-Jing
    Zhao, Guoying
    Liu, Yong-Jin
    Chen, Yu-Hsin
    Fu, Xiaolan
    PLOS ONE, 2014, 9 (01):
  • [46] Micro-expression spotting based on optical flow features
    He, Yuhong
    Xu, Zhongliang
    Ma, Lin
    Li, Haifeng
    PATTERN RECOGNITION LETTERS, 2022, 163 : 57 - 64
  • [47] Cross-Database Micro-Expression Recognition Exploiting Intradomain Structure
    Zhang, Yanliang
    Liu, Ying
    Wang, Hao
    JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
  • [48] FACIAL MICRO-EXPRESSION SPOTTING AND RECOGNITION USING TIME CONTRASTED FEATURE WITH VISUAL MEMORY
    Nag, Sauradip
    Bhunia, Ayan Kumar
    Konwer, Aishik
    Roy, Partha Pratim
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 2022 - 2026
  • [49] Spontaneous Facial Micro-expression Recognition via Deep Convolutional Network
    Xia, Zhaoqiang
    Feng, Xiaoyi
    Hong, Xiaopeng
    Zhao, Guoying
    2018 EIGHTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2018, : 235 - 240
  • [50] A Relaxed K-SVD Algorithm for Spontaneous Micro-Expression Recognition
    Zheng, Hao
    Geng, Xin
    Yang, Zhongxue
    PRICAI 2016: TRENDS IN ARTIFICIAL INTELLIGENCE, 2016, 9810 : 692 - 699