An interactive greeting system using convolutional neural networks for emotion recognition

被引：9
|
作者：
Lu, Ching-Ta [1 ,2 ,3 ]
Su, Chung-Wei [1 ]
Jiang, Hui-Ling [1 ,4 ]
Lu, Yen-Yu [1 ]
机构：
[1] Asia Univ, Dept Informat Commun, Taichung 41354, Taiwan
[2] Asia Univ, Dept Audiol & Speech Language Pathol, Taichung 41354, Taiwan
[3] China Med Univ, China Med Univ Hosp, Dept Med Res, Taichung 40402, Taiwan
[4] Natl Yang Ming Chiao Tung Univ, Dept Commun & Technol, Hsinchu 302, Taiwan
来源：
ENTERTAINMENT COMPUTING | 2022年 / 40卷
关键词：
Deep-learning; Convolutional neural network; Emotion recognition; Interactive greeting; Human-computer interaction;
D O I：
10.1016/j.entcom.2021.100452
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
The convolutional neural network (CNN) has been progressively applied in face recognition and various applications. This paper presents an interactive greeting system that combines face identification, emotion recognition, and funny 3D animation. The proposed system recognizes a user by a face-CNN and interacts with the user according to the recognized mood. The animated 3D girl plays a motion-dependent video according to the recognized user's emotion. First, we employ a Viola-Jones algorithm to segment the areas around the face, eyes, and mouth in a captured image. The face-CNN recognizes a known person. An eye-CNN and a mouth-CNN recognize the emotion. Finally, a 3D animation is played according to the identified emotion. Experimental results show that the proposed interactive greeting system recognizes target persons well, identifies the emotion adequately, and provides users to enjoy funny interaction.
引用
收藏
页数：11
相关论文
共 50 条
  • [1] Facial Emotion Recognition using Convolutional Neural Networks
    Rzayeva, Zeynab
    Alasgarov, Emin
    [J]. 2019 IEEE 13TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2019), 2019, : 91 - 95
  • [2] Facial emotion recognition using convolutional neural networks
    Sarvakar K.
    Senkamalavalli R.
    Raghavendra S.
    Santosh Kumar J.
    Manjunath R.
    Jaiswal S.
    [J]. Materials Today: Proceedings, 2023, 80 : 3560 - 3564
  • [3] Facial emotion recognition based music system using convolutional neural networks
    Sana, S. K.
    Sruthi, G.
    Suresh, D.
    Rajesh, G.
    Reddy, G. V. Subba
    [J]. MATERIALS TODAY-PROCEEDINGS, 2022, 62 : 4699 - 4706
  • [4] SPEECH EMOTION RECOGNITION USING QUATERNION CONVOLUTIONAL NEURAL NETWORKS
    Muppidi, Aneesh
    Radfar, Martin
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6309 - 6313
  • [5] Facial emotion recognition using convolutional neural networks (FERC)
    Ninad Mehendale
    [J]. SN Applied Sciences, 2020, 2
  • [6] Facial emotion recognition using convolutional neural networks (FERC)
    Mehendale, Ninad
    [J]. SN APPLIED SCIENCES, 2020, 2 (03)
  • [7] Music emotion recognition using deep convolutional neural networks
    Li, Ting
    [J]. JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2024, 24 (4-5) : 3063 - 3078
  • [8] Speech Emotion Recognition using Convolutional and Recurrent Neural Networks
    Lim, Wootaek
    Jang, Daeyoung
    Lee, Taejin
    [J]. 2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [9] Emotion Recognition in Horses with Convolutional Neural Networks
    Corujo, Luis A.
    Kieson, Emily
    Schloesser, Timo
    Gloor, Peter A.
    [J]. FUTURE INTERNET, 2021, 13 (10):
  • [10] Convolutional neural networks model for emotion recognition using EEG signal
    Ahmad I.S.
    Shuai P.R.
    Lingyue W.
    Saminu S.
    Isselmou A.E.K.
    Cai Z.
    Javaid I.
    Kamhi S.
    Kulsum U.
    [J]. International Journal of Circuits, Systems and Signal Processing, 2021, 15 : 417 - 433
12345