On the Performance Analysis of APIs Recognizing Emotions from Video Images of Facial Expressions

被引:5
|
作者
Bhattacharjee, Ananya [1 ]
Pias, Tanmoy [1 ]
Ahmad, Mahathir [1 ]
Rahman, Ashikur [1 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept CSE, Dhaka 1000, Bangladesh
关键词
Facial Expression Recognition; Emotion; API; Performance; RECOGNITION;
D O I
10.1109/ICMLA.2018.00040
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work is meant to provide insights towards state-of-the-art Application Programming Interfaces (APIs) commercially available today for recognizing emotions from video footprint of facial expressions. We analyze and compare performance of four such integrable commercial APIs using standard Extended Cohn-Kanade Dataset (CK+) containing over 10, 000 images with facial emotions and some randomly collected real life images. We also discuss issues to understand their limitations and adaptation as well as enhancement strategies. For performance analysis, we introduce the performance metric moving average to find the primary expression in the displayed emotion of a video sequence. Finally, using the popular valence-arousal dimensions, we show how to (lexicographically) order six basic emotions anger, happiness, sadness, surprise, fear and disgust. By providing neutral performance comparison, we hope to fill the existing notable gap between researchers, solution providers and application developers working on emotion based user modeling.
引用
收藏
页码:223 / 230
页数:8
相关论文
共 50 条
  • [41] Perception of Basic Emotions from Facial Expressions of Dynamic Virtual Avatars
    Faita, Claudia
    Vanni, Federico
    Lorenzini, Cristian
    Carrozzino, Marcello
    Tanca, Camilla
    Bergamasco, Massimo
    [J]. AUGMENTED AND VIRTUAL REALITY, AVR 2015, 2015, 9254 : 409 - 419
  • [42] Recognizing Emotions from Video in a Continuous 2D Space
    Ballano, Sergio
    Hupont, Isabelle
    Cerezo, Eva
    Baldassarri, Sandra
    [J]. HUMAN-COMPUTER INTERACTION - INTERACT 2011, PT IV, 2011, 6949 : 600 - 603
  • [43] Do we recognize facial expressions of emotions from persons with schizophrenia?
    Healey, Kristin M.
    Pinkham, Amy E.
    Richard, Jan A.
    Kohler, Christian G.
    [J]. SCHIZOPHRENIA RESEARCH, 2010, 122 (1-3) : 144 - 150
  • [44] The temporal dynamics of processing emotions from vocal, facial, and bodily expressions
    Jessen, S.
    Kotz, S. A.
    [J]. NEUROIMAGE, 2011, 58 (02) : 665 - 674
  • [45] Understanding emotions from standardized facial expressions in autism and normal development
    Castelli, F
    [J]. AUTISM, 2005, 9 (04) : 428 - 449
  • [46] Functional asymmetry and interhemispheric cooperation in the perception of emotions from facial expressions
    Tamietto, Marco
    Corazzini, Luca Latini
    de Gelder, Beatrice
    Geminiani, Giuliano
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2006, 171 (03) : 389 - 404
  • [47] Facial Expressions and Ability to Recognize Emotions From Eyes or Mouth in Children
    Guarnera, Maria
    Hichy, Zira
    Cascio, Maura I.
    Carrubba, Stefano
    [J]. EUROPES JOURNAL OF PSYCHOLOGY, 2015, 11 (02): : 183 - 196
  • [48] A Multicore Accelerated Implementation for Statistical Analysis of Facial Expressions in Video
    Bayrakdar, Sumeyye
    Yucedag, Ibrahim
    Akgun, Devrim
    [J]. 2016 XITH INTERNATIONAL SCIENTIFIC AND TECHNICAL CONFERENCE COMPUTER SCIENCES AND INFORMATION TECHNOLOGIES (CSIT), 2016, : 62 - 65
  • [49] Recognizing Intensity Degrees from Expressions in 3D Facial Meshes
    Sanchez, A.
    Moreno, A. B.
    Velez, J. F.
    Conci, A.
    [J]. 2013 20TH INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING (IWSSIP 2013), 2013, : 23 - 26
  • [50] I remember your smile: Recognizing facial emotions from a brief acquaintance
    Hamon-Hill, Cindy
    Barresi, John
    [J]. CANADIAN JOURNAL OF EXPERIMENTAL PSYCHOLOGY-REVUE CANADIENNE DE PSYCHOLOGIE EXPERIMENTALE, 2008, 62 (04): : 307 - 307