Towards More Robust Automatic Facial Expression Recognition in Smart Environments

被引:13
|
作者
Bernin, Arne [1 ,2 ]
Mueller, Larissa [1 ,2 ]
Ghose, Sobin [1 ]
von Luck, Kai [1 ]
Grecos, Christos [3 ]
Wang, Qi [4 ]
Vogt, Florian [5 ]
机构
[1] Hamburg Univ Appl Sci, Dept Informat, Hamburg, Germany
[2] Univ West Scotland, Engn & Comp, Glasgow, Lanark, Scotland
[3] Cent Washington Univ CWU, Comp Sci Dept, Ellensburg, WA USA
[4] Univ West Scotland, Sch Engn & Comp, Glasgow, Lanark, Scotland
[5] Hamburg Univ Appl Sci, Innovat Kontakt Stelle IKS Hamburg, Hamburg, Germany
关键词
Affective Computing; Facial Expression Recognition; Benchmark; Application specific Clustering of Emotions;
D O I
10.1145/3056540.3056546
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we provide insights towards achieving more robust automatic facial expression recognition in smart environments based on our benchmark with three labeled facial expression databases. These databases are selected to test for desktop, 3D and smart environment application scenarios. This work is meant to provide a neutral comparison and guidelines for developers and researchers interested to integrate facial emotion recognition technologies in their applications, understand its limitations and adaptation as well as enhancement strategies. We also introduce and compare three different metrics for finding the primary expression in a time window of a displayed emotion. In addition, we outline facial emotion recognition limitations and enhancements for smart environments and non-frontal setups. By providing our comparison and enhancements we hope to build a bridge from affective computing research and solution providers to application developers that like to enhance new applications by including emotion based user modeling.
引用
收藏
页码:37 / 44
页数:8
相关论文
共 50 条
  • [31] An automatic improved facial expression recognition for masked faces
    ELsayed, Yasmeen
    ELSayed, Ashraf
    Abdou, Mohamed A.
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (20): : 14963 - 14972
  • [32] Automatic Facial Expression Recognition Based on Hybrid Approach
    Bermani, Ali K. K.
    Ghalwash, Atef Z.
    Youssif, Aliaa A. A.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2012, 3 (11) : 102 - 107
  • [33] A model based method for automatic facial expression recognition
    van Kuilenburg, H
    Wiering, M
    den Uyl, M
    MACHINE LEARNING: ECML 2005, PROCEEDINGS, 2005, 3720 : 194 - 205
  • [34] Automatic facial expression recognition based on spatiotemporal descriptors
    Ji, Yi
    Idrissi, Khalid
    PATTERN RECOGNITION LETTERS, 2012, 33 (10) : 1373 - 1380
  • [35] An automatic improved facial expression recognition for masked faces
    Yasmeen ELsayed
    Ashraf ELSayed
    Mohamed A. Abdou
    Neural Computing and Applications, 2023, 35 : 14963 - 14972
  • [36] AUTOMATIC RECOGNITION OF FACIAL EXPRESSION BASED ON COMPUTER VISION
    Zhu, Shaoping
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2015, 8 (03): : 1464 - 1483
  • [37] Late fusion of facial dynamics for automatic expression recognition
    Bandrabur, Alessandra
    Florea, Laura
    Florea, Cornel
    Mancas, Matei
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2017, 25 (04) : 2696 - 2707
  • [38] Robust Automatic Speech Recognition for Accented Mandarin in Car Environments
    Pei Ding
    Lei He
    Xiang Yan
    Jie Hao
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 2542 - 2545
  • [39] A robust feature extraction for automatic speech recognition in noisy environments
    Lima, C
    Almeida, LB
    Monteiro, JL
    2002 6TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS I AND II, 2002, : 540 - 543
  • [40] Facial Expression Recognition by Sparse Reconstruction with Robust Features
    Mourao, Andre
    Borges, Pedro
    Correia, Nuno
    Magalhaes, Joao
    IMAGE ANALYSIS AND RECOGNITION, 2013, 7950 : 107 - 115