An interactive greeting system using convolutional neural networks for emotion recognition

被引：10
|
作者：
Lu, Ching-Ta [1 ,2 ,3 ]
Su, Chung-Wei [1 ]
Jiang, Hui-Ling [1 ,4 ]
Lu, Yen-Yu [1 ]
机构：
[1] Asia Univ, Dept Informat Commun, Taichung 41354, Taiwan
[2] Asia Univ, Dept Audiol & Speech Language Pathol, Taichung 41354, Taiwan
[3] China Med Univ, China Med Univ Hosp, Dept Med Res, Taichung 40402, Taiwan
[4] Natl Yang Ming Chiao Tung Univ, Dept Commun & Technol, Hsinchu 302, Taiwan
来源：
ENTERTAINMENT COMPUTING | 2022年 / 40卷
关键词：
Deep-learning; Convolutional neural network; Emotion recognition; Interactive greeting; Human-computer interaction;
D O I：
10.1016/j.entcom.2021.100452
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
The convolutional neural network (CNN) has been progressively applied in face recognition and various applications. This paper presents an interactive greeting system that combines face identification, emotion recognition, and funny 3D animation. The proposed system recognizes a user by a face-CNN and interacts with the user according to the recognized mood. The animated 3D girl plays a motion-dependent video according to the recognized user's emotion. First, we employ a Viola-Jones algorithm to segment the areas around the face, eyes, and mouth in a captured image. The face-CNN recognizes a known person. An eye-CNN and a mouth-CNN recognize the emotion. Finally, a 3D animation is played according to the identified emotion. Experimental results show that the proposed interactive greeting system recognizes target persons well, identifies the emotion adequately, and provides users to enjoy funny interaction.
引用
收藏
页数：11
相关论文
共 50 条
  • [1] Facial Emotion Recognition using Convolutional Neural Networks
    Rzayeva, Zeynab
    Alasgarov, Emin
    2019 IEEE 13TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2019), 2019, : 91 - 95
  • [2] Facial Emotion Recognition using Convolutional Neural Networks
    Gopichand, G.
    Reddy, I. Ravi Prakash
    Santhi, H.
    Akula, Vijaya Krishna
    IMPENDING INQUISITIONS IN HUMANITIES AND SCIENCES, ICIIHS-2022, 2024, : 198 - 203
  • [3] Facial emotion recognition using convolutional neural networks
    Sarvakar K.
    Senkamalavalli R.
    Raghavendra S.
    Santosh Kumar J.
    Manjunath R.
    Jaiswal S.
    Materials Today: Proceedings, 2023, 80 : 3560 - 3564
  • [4] Facial emotion recognition based music system using convolutional neural networks
    Sana, S. K.
    Sruthi, G.
    Suresh, D.
    Rajesh, G.
    Reddy, G. V. Subba
    MATERIALS TODAY-PROCEEDINGS, 2022, 62 : 4699 - 4706
  • [5] Facial emotion recognition using convolutional neural networks (FERC)
    Ninad Mehendale
    SN Applied Sciences, 2020, 2
  • [6] SPEECH EMOTION RECOGNITION USING QUATERNION CONVOLUTIONAL NEURAL NETWORKS
    Muppidi, Aneesh
    Radfar, Martin
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6309 - 6313
  • [7] Facial emotion recognition using convolutional neural networks (FERC)
    Mehendale, Ninad
    SN APPLIED SCIENCES, 2020, 2 (03):
  • [8] Music emotion recognition using deep convolutional neural networks
    Li, Ting
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2024, 24 (4-5) : 3063 - 3078
  • [9] Speech Emotion Recognition using Convolutional and Recurrent Neural Networks
    Lim, Wootaek
    Jang, Daeyoung
    Lee, Taejin
    2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [10] Emotion Recognition in Horses with Convolutional Neural Networks
    Corujo, Luis A.
    Kieson, Emily
    Schloesser, Timo
    Gloor, Peter A.
    FUTURE INTERNET, 2021, 13 (10):
12345