Towards More Robust Automatic Facial Expression Recognition in Smart Environments

被引:13
|
作者
Bernin, Arne [1 ,2 ]
Mueller, Larissa [1 ,2 ]
Ghose, Sobin [1 ]
von Luck, Kai [1 ]
Grecos, Christos [3 ]
Wang, Qi [4 ]
Vogt, Florian [5 ]
机构
[1] Hamburg Univ Appl Sci, Dept Informat, Hamburg, Germany
[2] Univ West Scotland, Engn & Comp, Glasgow, Lanark, Scotland
[3] Cent Washington Univ CWU, Comp Sci Dept, Ellensburg, WA USA
[4] Univ West Scotland, Sch Engn & Comp, Glasgow, Lanark, Scotland
[5] Hamburg Univ Appl Sci, Innovat Kontakt Stelle IKS Hamburg, Hamburg, Germany
关键词
Affective Computing; Facial Expression Recognition; Benchmark; Application specific Clustering of Emotions;
D O I
10.1145/3056540.3056546
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we provide insights towards achieving more robust automatic facial expression recognition in smart environments based on our benchmark with three labeled facial expression databases. These databases are selected to test for desktop, 3D and smart environment application scenarios. This work is meant to provide a neutral comparison and guidelines for developers and researchers interested to integrate facial emotion recognition technologies in their applications, understand its limitations and adaptation as well as enhancement strategies. We also introduce and compare three different metrics for finding the primary expression in a time window of a displayed emotion. In addition, we outline facial emotion recognition limitations and enhancements for smart environments and non-frontal setups. By providing our comparison and enhancements we hope to build a bridge from affective computing research and solution providers to application developers that like to enhance new applications by including emotion based user modeling.
引用
收藏
页码:37 / 44
页数:8
相关论文
共 50 条
  • [1] Towards a robust affect recognition: Automatic facial expression recognition in 3D faces
    Azazi, Amal
    Lotfi, Syaheerah Lebai
    Venkat, Ibrahim
    Fernandez-Martinez, Fernando
    EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (06) : 3056 - 3066
  • [2] Robust technologies towards automatic speech recognition in car noise environments
    Ding, Pei
    He, Lei
    Yan, Xiang
    Zhao, Rui
    Hao, Jie
    2006 8TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-4, 2006, : 776 - +
  • [3] Automatic facial expression recognition
    Lu, Huchuan
    Wu, Pei
    Lin, Hui
    Yang, Deli
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 2, PROCEEDINGS, 2006, 3972 : 63 - 68
  • [4] Towards smart glasses for facial expression recognition using OMG and machine learning
    Kiprijanovska, Ivana
    Stankoski, Simon
    Broulidakis, M. John
    Archer, James
    Fatoorechi, Mohsen
    Gjoreski, Martin
    Nduka, Charles
    Gjoreski, Hristijan
    SCIENTIFIC REPORTS, 2023, 13 (01):
  • [5] Towards smart glasses for facial expression recognition using OMG and machine learning
    Ivana Kiprijanovska
    Simon Stankoski
    M. John Broulidakis
    James Archer
    Mohsen Fatoorechi
    Martin Gjoreski
    Charles Nduka
    Hristijan Gjoreski
    Scientific Reports, 13 (1)
  • [6] Automatic Facial Expression Recognition: An Overview
    Wang, Chunmao
    Huang, Xiaohua
    Zheng, Wenming
    MBE 2008: ASIA -PACIFIC CONFERENCE ON MIND BRAIN AND EDUCATION, 2008, : 365 - 368
  • [7] AUTOMATIC FACIAL EXPRESSION RECOGNITION SYSTEM
    Balasubramani, A.
    Kalaivanan, K.
    Karpagalakshmi, R. C.
    Monikandan, R.
    ICCN: 2008 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING, 2008, : 509 - 513
  • [8] Automatic Facial Expression Recognition System
    Mliki, Hazar
    Fourati, Nesrine
    Smaoui, Souhail
    Hammami, Mohamed
    2013 ACS INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2013,
  • [9] Review on automatic facial expression recognition
    Mase, Kenji
    Kyokai Joho Imeji Zasshi/Journal of the Institute of Image Information and Television Engineers, 1997, 51 (08): : 1136 - 1139
  • [10] Automatic facial feature extraction and facial expression recognition
    Dubuisson, S
    Davoine, F
    Cocquerez, JP
    AUDIO- AND VIDEO-BASED BIOMETRIC PERSON AUTHENTICATION, PROCEEDINGS, 2001, 2091 : 121 - 126