With the rapid development of deep learning and wireless communication technology, emotion recognition has received more and more attention from researchers. Computers can only be truly intelligent when they have human emotions, and emotion recognition is its primary consideration. This paper proposes a multimodal emotion recognition model based on a multiobjective optimization algorithm. The model combines voice information and facial information and can optimize the accuracy and uniformity of recognition at the same time. The speech modal is based on an improved deep convolutional neural network (DCNN); the video image modal is based on an improved deep separation convolution network (DSCNN). After single mode recognition, a multiobjective optimization algorithm is used to fuse the two modalities at the decision level. The experimental results show that the proposed model has a large improvement in each evaluation index, and the accuracy of emotion recognition is 2.88% higher than that of the ISMS_ALA model. The results show that the multiobjective optimization algorithm can effectively improve the performance of the multimodal emotion recognition model.
机构:
Changchun Univ, Int Exchange & Cooperat Dept, Changchun 132022, Jilin, Peoples R ChinaChangchun Univ, Sch Int Educ, Changchun 132022, Peoples R China
机构:
Qingdao Univ, Coll Elect Informat, Qingdao, Shandong, Peoples R ChinaQingdao Univ, Coll Elect Informat, Qingdao, Shandong, Peoples R China
Yang, Tianjiao
He, Ying
论文数: 0引用数: 0
h-index: 0
机构:
Qingdao Univ, Coll Elect Informat, Qingdao, Shandong, Peoples R ChinaQingdao Univ, Coll Elect Informat, Qingdao, Shandong, Peoples R China
He, Ying
Yang, Ning
论文数: 0引用数: 0
h-index: 0
机构:
Qingdao Lanzhi Modern Serv Ind Digital Engn Techn, Qingdao 266071, Shandong, Peoples R ChinaQingdao Univ, Coll Elect Informat, Qingdao, Shandong, Peoples R China
机构:
Changchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R ChinaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China
Xing, Tianye
Wang, Yidan
论文数: 0引用数: 0
h-index: 0
机构:
Changchun Univ Technol, Coll Humanities 8 Informat, Dept Informat Engn, Changchun 130122, Peoples R ChinaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China
Wang, Yidan
Liu, Yingxue
论文数: 0引用数: 0
h-index: 0
机构:
Monash Univ, Dept Civil Engn, Wellington Rd, Clayton, Vic 3800, AustraliaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China
Liu, Yingxue
Wu, Qi
论文数: 0引用数: 0
h-index: 0
机构:
Shangfan Sch Culture & Arts Co Ltd, Tiedong 136099, Jilin Siping, Peoples R ChinaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China
Wu, Qi
Ma, Rong
论文数: 0引用数: 0
h-index: 0
机构:
Baoding Surveying & Mapping Ctr House, Baoding Diangu Technol Ctr, 3-B-403, Baoding, Hebei, Peoples R ChinaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China
Ma, Rong
Shang, Xiaoling
论文数: 0引用数: 0
h-index: 0
机构:
Changchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R ChinaChangchun Univ Chinese Med, Coll Basic Med, Changchun 130117, Peoples R China