An interactive greeting system using convolutional neural networks for emotion recognition

被引：10

作者：

Lu, Ching-Ta ^{[1
,2
,3
]}

Su, Chung-Wei ^{[1
]}

Jiang, Hui-Ling ^{[1
,4
]}

Lu, Yen-Yu ^{[1
]}

机构：

[1] Asia Univ, Dept Informat Commun, Taichung 41354, Taiwan

[2] Asia Univ, Dept Audiol & Speech Language Pathol, Taichung 41354, Taiwan

[3] China Med Univ, China Med Univ Hosp, Dept Med Res, Taichung 40402, Taiwan

[4] Natl Yang Ming Chiao Tung Univ, Dept Commun & Technol, Hsinchu 302, Taiwan

来源：

ENTERTAINMENT COMPUTING | 2022年 / 40卷

关键词：

Deep-learning; Convolutional neural network; Emotion recognition; Interactive greeting; Human-computer interaction;

D O I：

10.1016/j.entcom.2021.100452

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

The convolutional neural network (CNN) has been progressively applied in face recognition and various applications. This paper presents an interactive greeting system that combines face identification, emotion recognition, and funny 3D animation. The proposed system recognizes a user by a face-CNN and interacts with the user according to the recognized mood. The animated 3D girl plays a motion-dependent video according to the recognized user's emotion. First, we employ a Viola-Jones algorithm to segment the areas around the face, eyes, and mouth in a captured image. The face-CNN recognizes a known person. An eye-CNN and a mouth-CNN recognize the emotion. Finally, a 3D animation is played according to the identified emotion. Experimental results show that the proposed interactive greeting system recognizes target persons well, identifies the emotion adequately, and provides users to enjoy funny interaction.

引用

页数：11

共 50 条

[31] Emotion in Robots Using Convolutional Neural Networks
Ghayoumi, Mehdi
Bansal, Arvind K.
SOCIAL ROBOTICS, (ICSR 2016), 2016, 9979 : 285 - 295
[32] Emotion Recognition Using Neural Networks
Unluturk, Mehmet S.
Oguz, Kaya
Atay, Coskun
NN'09: PROCEEDINGS OF THE 10TH WSEAS INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, 2009, : 82 - 85
[33] Emotion Recognition System from Speech and Visual Information based on Convolutional Neural Networks
Ristea, Nicolae-Catalin
Dutu, Liviu Cristian
Radoi, Anamaria
2019 10TH INTERNATIONAL CONFERENCE ON SPEECH TECHNOLOGY AND HUMAN-COMPUTER DIALOGUE (SPED), 2019,
[34] IMPROVING CONVOLUTIONAL RECURRENT NEURAL NETWORKS FOR SPEECH EMOTION RECOGNITION
Meyer, Patrick
Xu, Ziyi
Fingscheidt, Tim
2021 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP (SLT), 2021, : 365 - 372
[35] Gender Differentiated Convolutional Neural Networks for Speech Emotion Recognition
Mishra, Puneet
Sharma, Ruchir
2020 12TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT 2020), 2020, : 142 - 148
[36] FSER: Deep Convolutional Neural Networks for Speech Emotion Recognition
Dossou, Bonaventure F. P.
Gbenou, Yeno K. S.
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 3526 - 3531
[37] An Efficient Approach to Face Emotion Recognition with Convolutional Neural Networks
Bialek, Christian
Matiolanski, Andrzej
Grega, Michal
ELECTRONICS, 2023, 12 (12)
[38] Emotion Recognition of Online Education Learners by Convolutional Neural Networks
Ye, Fulan
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
[39] Emotion recognition based on facial gestures and Convolutional Neural Networks
Sanchez-Callejas, Francisco Emiliano
Cruz-Albarran, Irving A.
Morales-Hernandez, Luis A.
2024 IEEE 3RD CONFERENCE ON INFORMATION TECHNOLOGY AND DATA SCIENCE, CITDS 2024, 2024, : 193 - 198
[40] EEG Emotion Recognition using Parallel Hybrid Convolutional-Recurrent Neural Networks
Putri, Nursilva Aulianisa
Djamal, Esmeralda Contessa
Nugraha, Fikri
Kasyidi, Fatan
2022 INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ITS APPLICATIONS (ICODSA), 2022, : 24 - 29

← 1 2 3 4 5 →