Emotion recognition and artificial intelligence: A systematic review (2014-2023) and research recommendations

被引:45
|
作者
Khare, Smith K. [1 ]
Blanes-Vidal, Victoria [1 ]
Nadimi, Esmaeil S. [1 ]
Acharya, U. Rajendra [2 ]
机构
[1] Univ Southern Denmark, Maersk Mc Kinney Moller Inst, Fac Engn, Appl & Data Sci Unit, Odense, Denmark
[2] Univ Southern Queensland, Sch Math Phys & Comp, Springfield, Qld, Australia
关键词
Emotion recognition; Speech; Facial images; Electroencephalogram; Electrocardiogram; Eye tracking; Galvanic skin response; Artificial intelligence; Machine learning; Deep learning; FEATURE-EXTRACTION; NEURAL-NETWORK; LEARNING TECHNIQUES; MODE DECOMPOSITION; SPEECH; EEG; CHILDREN; ATTENTION; SIGNALS; ELECTROCARDIOGRAM;
D O I
10.1016/j.inffus.2023.102019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition is the ability to precisely infer human emotions from numerous sources and modalities using questionnaires, physical signals, and physiological signals. Recently, emotion recognition has gained attention because of its diverse application areas, like affective computing, healthcare, human-robot interactions, and market research. This paper provides a comprehensive and systematic review of emotion recognition techniques of the current decade. The paper includes emotion recognition using physical and physiological signals. Physical signals involve speech and facial expression, while physiological signals include electroencephalogram, electrocardiogram, galvanic skin response, and eye tracking. The paper provides an introduction to various emotion models, stimuli used for emotion elicitation, and the background of existing automated emotion recognition systems. This paper covers comprehensive searching and scanning of wellknown datasets followed by design criteria for review. After a thorough analysis and discussion, we selected 142 journal articles using PRISMA guidelines. The review provides a detailed analysis of existing studies and available datasets of emotion recognition. Our review analysis also presented potential challenges in the existing literature and directions for future research.
引用
收藏
页数:36
相关论文
共 50 条
  • [31] Applications of artificial intelligence/machine learning approaches in cardiovascular medicine: a systematic review with recommendations
    Friedrich, Sarah
    Gross, Stefan
    Koenig, Inke R.
    Engelhardt, Sandy
    Bahls, Martin
    Heinz, Judith
    Huber, Cynthia
    Kaderali, Lars
    Kelm, Marcus
    Leha, Andreas
    Ruehl, Jasmin
    Schaller, Jens
    Scherer, Clemens
    Vollmer, Marcus
    Seidler, Tim
    Friede, Tim
    [J]. EUROPEAN HEART JOURNAL - DIGITAL HEALTH, 2021, 2 (03): : 424 - 436
  • [32] Exploration and research on the service quality upgrading of scenic spots based on the emotion recognition of artificial intelligence
    Liu, Tingting
    [J]. BASIC & CLINICAL PHARMACOLOGY & TOXICOLOGY, 2020, 126 : 70 - 70
  • [33] A systematic review of research on emotional artificial intelligence in English language education
    Liu, Yuhan
    Zhang, Heng
    Jiang, Meilin
    Chen, Juanjuan
    Wang, Minhong
    [J]. SYSTEM, 2024, 126
  • [34] Artificial intelligence applications in solid waste management: A systematic research review
    Abdallah, Mohamed
    Abu Talib, Manar
    Feroz, Sainab
    Nasir, Qassim
    Abdalla, Hadeer
    Mahfood, Bayan
    [J]. WASTE MANAGEMENT, 2020, 109 : 231 - 246
  • [35] TECHNOLOGICAL INNOVATIONS AND ARTIFICIAL INTELLIGENCE IN INTERNATIONAL MARKETING RESEARCH: A SYSTEMATIC REVIEW
    Iaia, L.
    Christofi, M.
    Vrontis, D.
    [J]. 13TH ANNUAL CONFERENCE OF THE EUROMED ACADEMY OF BUSINESS: BUSINESS THEORY AND PRACTICE ACROSS INDUSTRIES AND MARKETS, 2020, : 1358 - 1360
  • [36] Water treatment and artificial intelligence techniques: a systematic literature review research
    Ismail, Waidah
    Niknejad, Naghmeh
    Bahari, Mahadi
    Hendradi, Rimuljo
    Zaizi, Nurzi Juana Mohd
    Zulkifli, Mohd Zamani
    [J]. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2023, 30 (28) : 71794 - 71812
  • [37] Water treatment and artificial intelligence techniques: a systematic literature review research
    Waidah Ismail
    Naghmeh Niknejad
    Mahadi Bahari
    Rimuljo Hendradi
    Nurzi Juana Mohd Zaizi
    Mohd Zamani Zulkifli
    [J]. Environmental Science and Pollution Research, 2023, 30 : 71794 - 71812
  • [38] A review of artificial intelligence methods enabled music-evoked EEG emotion recognition and their applications
    Su, Yan
    Liu, Yong
    Xiao, Yan
    Ma, Jiaqi
    Li, Dezhao
    [J]. FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [39] Artificial Intelligence of Behavior for Human Emotion Recognition in Closed Environments
    Alvarez-Garcia, Gonzalo-Alberto
    Zuniga-Canon, Claudia
    Garcia-Sanchez, Antonio-Javier
    Garcia-Haro, Joan
    Sarria-Paja, Milton
    Asorey-Cacheda, Rafael
    [J]. IEEE Open Journal of the Computer Society, 2024, 5 : 578 - 588
  • [40] Artificial intelligence and empathy. From life with emotion recognition
    Samuel, Janina Luise
    Schmiljun, Andre
    [J]. AI & SOCIETY, 2023, 38 (06) : 2717 - 2721