A discriminative deep association learning for facial expression recognition

被引:17
|
作者
Jin, Xing [1 ,2 ]
Sun, Wenyun [3 ]
Jin, Zhong [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Engn & Comp Sci, Nanjing 210094, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Key Lab Intelligent Percept & Syst High Dimens In, Minist Educ, Nanjing 210094, Jiangsu, Peoples R China
[3] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Guangdong, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Facial expression recognition; Association learning; Deep network; Synthetic facial expression;
D O I
10.1007/s13042-019-01024-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning based facial expression recognition becomes more successful in many applications. However, the lack of labeled data is still a bottleneck for better recognition performance. Thus, it is of practical significance to exploit the rich unlabeled data for training deep neural networks (DNNs). In this paper, we propose a novel discriminative deep association learning (DDAL) framework. The unlabeled data is provided to train the DNNs with the labeled data simultaneously, in a multi-loss deep network based on association learning. Moreover, the discrimination loss is also utilized to ensure intra-class clustering and inter-class centers separating. Furthermore, a large synthetic facial expression dataset is generated and used as unlabeled data. By exploiting association learning mechanism on two facial expression datasets, competitive results are obtained. By utilizing synthetic data, the performance is increased clearly.
引用
收藏
页码:779 / 793
页数:15
相关论文
共 50 条
  • [41] Deep Neural Networks with Relativity Learning for Facial Expression Recognition
    Guo, Yanan
    Tao, Dapeng
    Yu, Jun
    Xiong, Hao
    Li, Yaotang
    Tao, Dacheng
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2016,
  • [42] Facial Expression Recognition System for Stress Detection with Deep Learning
    Almeida, Jose
    Rodrigues, Fatima
    [J]. PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS (ICEIS 2021), VOL 1, 2021, : 256 - 263
  • [43] Automated Facial Expression Recognition Framework Using Deep Learning
    Saeed, Saad
    Shah, Asghar Ali
    Ehsan, Muhammad Khurram
    Amirzada, Muhammad Rizwan
    Mahmood, Asad
    Mezgebo, Teweldebrhan
    [J]. Journal of Healthcare Engineering, 2022, 2022
  • [44] Local Learning With Deep and Handcrafted Features for Facial Expression Recognition
    Georgescu, Mariana-Iuliana
    Ionescu, Radu Tudor
    Popescu, Marius
    [J]. IEEE ACCESS, 2019, 7 : 64827 - 64836
  • [45] Facial expression recognition using lightweight deep learning modeling
    Ahmad, Mubashir
    Saira
    Alfandi, Omar
    Khattak, Asad Masood
    Qadri, Syed Furqan
    Saeed, Iftikhar Ahmed
    Khan, Salabat
    Hayat, Bashir
    Ahmad, Arshad
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (05) : 8208 - 8225
  • [46] Facial Expression Recognition using Visual Saliency and Deep Learning
    Mavani, Viraj
    Raman, Shanmuganathan
    Miyapuram, Krishna P.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2783 - 2788
  • [47] Facial expression recognition via learning deep sparse autoencoders
    Zeng, Nianyin
    Zhang, Hong
    Song, Baoye
    Liu, Weibo
    Li, Yurong
    Dobaie, Abdullah M.
    [J]. NEUROCOMPUTING, 2018, 273 : 643 - 649
  • [48] Enhancing masked facial expression recognition with multimodal deep learning
    Shahzad, H. M.
    Bhatti, Sohail Masood
    Jaffar, Arfan
    Akram, Sheeraz
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (30) : 73911 - 73921
  • [49] Deep Disturbance-Disentangled Learning for Facial Expression Recognition
    Ruan, Delian
    Yan, Yan
    Chen, Si
    Xue, Jing-Hao
    Wang, Hanzi
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2833 - 2841
  • [50] Facial Expression Recognition of Animated Characters using Deep Learning
    Lakhani, Mohd Ismail
    McDermott, James
    Glavin, Frank G.
    Nagarajan, Sai Priya
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,