A SELF-SUPERVISED DIFFUSION FRAMEWORK FOR FACIAL EMOTION RECOGNITION

被引:0
|
作者
Hassan, Saif [1 ,2 ]
Ullah, Mohib [1 ]
Imran, Ali Shariq [1 ]
Mujtaba, Ghulam [2 ]
Yamin, Muhammad Mudassar [3 ]
Hashmi, Ehtesham [3 ]
Cheikh, Faouzi Alaya [1 ]
Beghdadi, Azeddine [1 ,4 ]
机构
[1] Norwegian Univ Sci & Technol NTNU, Intelligent Syst & Analyt ISA Res Grp, Dept Comp Sci IDI, N-2815 Gjovik, Norway
[2] Sukkur IBA Univ, Dept Comp Sci, Sukkur 65200, Pakistan
[3] NTNU Norway, Dept Informat Secur & Commun Technol, Trondheim, Norway
[4] Univ Sorbonne Paris Nord, Paris, France
关键词
Diffusion model; self-supervised learning; attention mechanism; facial emotion recognition;
D O I
10.1109/ICIP51287.2024.10648251
中图分类号
学科分类号
摘要
In this paper, we introduced a novel Facial Emotion Recognition (FER) framework that utilizes a diffusion-based approach and an attention mechanism. The model is efficiently trained through self-supervised learning, leveraging labeled and unlabelled data. The proposed framework has been rigorously tested on the FER2013 and AffectNet datasets, achieving promising accuracies of 67.2% and 68.1%, respectively. The quantitative results not only surpass the performance of existing state-of-the-art FER models but also demonstrate the synergistic effect of combining diffusion-based modeling with self-supervised learning and attention mechanisms within a solid architectural framework. Our approach sets a new benchmark in the field, offering a significant step forward in the accurate and efficient recognition of facial expressions.
引用
收藏
页码:465 / 471
页数:7
相关论文
共 50 条
  • [21] MSLTE: multiple self-supervised learning tasks for enhancing EEG emotion recognition
    Li, Guangqiang
    Chen, Ning
    Niu, Yixiang
    Xu, Zhangyong
    Dong, Yuxuan
    Jin, Jing
    Zhu, Hongqin
    JOURNAL OF NEURAL ENGINEERING, 2024, 21 (02)
  • [22] MSL-FER: MIRRORED SELF-SUPERVISED LEARNING FOR FACIAL EXPRESSION RECOGNITION
    Pan, Xiangshuai
    Liu, Weifeng
    Wang, Yanjiang
    Lu, Xiaoping
    Liu, Baodi
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 1601 - 1605
  • [23] A Self-Supervised Learning Network for Student Engagement Recognition From Facial Expressions
    Zhang, Wen-Long
    Jia, Rui-Sheng
    Wang, Hu
    Che, Cheng-Yue
    Sun, Hong-Mei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12399 - 12410
  • [24] Opt-SSL: An Enhanced Self-Supervised Framework for Food Recognition
    Ballus, Nil
    Nagarajan, Bhalaji
    Radeva, Petia
    PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2022), 2022, 13256 : 655 - 666
  • [25] Self-supervised facial expression recognition with fine-grained feature selection
    An, Heng-Yu
    Jia, Rui-Sheng
    VISUAL COMPUTER, 2024, 40 (10): : 7001 - 7013
  • [26] Self-Supervised Regional and Temporal Auxiliary Tasks for Facial Action Unit Recognition
    Yan, Jingwei
    Wang, Jingjing
    Li, Qiang
    Wang, Chunmao
    Pu, Shiliang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1038 - 1046
  • [27] Joint facial action unit recognition and self-supervised optical flow estimation
    Shao, Zhiwen
    Zhou, Yong
    Li, Feiran
    Zhu, Hancheng
    Liu, Bing
    PATTERN RECOGNITION LETTERS, 2024, 181 : 70 - 76
  • [28] Hybrid-View Self-Supervised Framework for Automatic Modulation Recognition
    Fu, Youquan
    Ma, Yue
    Feng, Zhixi
    Yang, Shuyuan
    Wang, Yixing
    IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (06): : 7360 - 7375
  • [29] DEEP INVESTIGATION OF INTERMEDIATE REPRESENTATIONS IN SELF-SUPERVISED LEARNING MODELS FOR SPEECH EMOTION RECOGNITION
    Zhu, Zhi
    Sato, Yoshinao
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [30] Transformer-Based Self-Supervised Multimodal Representation Learning for Wearable Emotion Recognition
    Wu, Yujin
    Daoudi, Mohamed
    Amad, Ali
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (01) : 157 - 172