Fully automatic facial action recognition in spontaneous behavior

被引:137
|
作者
Bartlett, Marian Stewart [1 ]
Littlewort, Gwen [1 ]
Frank, Mark [2 ]
Lainscsek, Claudia [1 ]
Fasel, Ian [1 ]
Movellan, Javier [1 ]
机构
[1] Univ Calif San Diego, Inst Neural Computat, La Jolla, CA 92093 USA
[2] SUNY Buffalo, Buffalo, NY USA
关键词
D O I
10.1109/fgr.2006.55
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present results on a user independent fully automatic system for real time recognition of facial actions from the Facial Action Coding System (FACS). The system automatically detects frontal faces in the video stream and codes each frame with respect to 20 Action units. We present preliminary results on a task of facial action detection in spontaneous expressions during discourse. Support vector machines and AdaBoost classifiers are compared. For both classifiers, the output margin predicts action unit intensity.
引用
收藏
页码:223 / +
页数:2
相关论文
共 50 条
  • [1] Fully automatic upper facial action recognition
    Kapoor, A
    Qi, Y
    Picard, RW
    [J]. IEEE INTERNATIONAL WORKSHOP ON ANALYSIS AND MODELING OF FACE AND GESTURES, 2003, : 195 - 202
  • [2] Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior
    Cohn, JF
    Reed, LI
    Ambadar, Z
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 610 - 616
  • [3] An approach to automatic recognition of spontaneous facial actions
    Braathen, B
    Bartlett, MS
    Littlewort, G
    Smith, E
    Movellan, JR
    [J]. FIFTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2002, : 360 - 365
  • [4] Fully Automatic Recognition of the Temporal Phases of Facial Actions
    Valstar, Michel F.
    Pantic, Maja
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (01): : 28 - 43
  • [5] Spontaneous Facial Expression Recognition: Automatic Aggression Detection
    Piatkowska, Ewa
    Martyna, Jerzy
    [J]. HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PT I, 2012, 7208 : 147 - 158
  • [6] Machine learning methods for fully automatic recognition of facial expressions and facial actions
    Bartlett, MS
    Littlewort, G
    Lainscsek, C
    Fasel, I
    Movellan, J
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN & CYBERNETICS, VOLS 1-7, 2004, : 592 - 597
  • [7] Configural Representation of Facial Action Units for Spontaneous Facial Expression Recognition in the Wild
    Perveen, Nazil
    Mohan, Chalavadi Krishna
    [J]. VISAPP: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4: VISAPP, 2020, : 93 - 102
  • [8] Data Mining Spontaneous Facial Behavior with Automatic Expression Coding
    Bartlett, Marian
    Littlewort, Gwen
    Vural, Esra
    Lee, Kang
    Cetin, Mujdat
    Ercil, Aytul
    Movellan, Javier
    [J]. VERBAL AND NONVERBAL FEATURES OF HUMAN-HUMAN AND HUMAN-MACHINE INTERACTIONS, 2008, 5042 : 1 - +
  • [9] Proposed architecture of a Fully Integrated Modular Neural Network-based Automatic Facial Emotion Recognition system based on Facial Action Coding System
    Gavrilescu, Mihai
    [J]. 2014 10TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS (COMM), 2014,
  • [10] Fully Automatic Methodology for Human Action Recognition Incorporating Dynamic Information
    Gonzalez, Ana
    Ortega Hortas, Marcos
    Penedo, Manuel G.
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, 2011, 7042 : 173 - 180