A SELF-SUPERVISED DIFFUSION FRAMEWORK FOR FACIAL EMOTION RECOGNITION

被引:0
|
作者
Hassan, Saif [1 ,2 ]
Ullah, Mohib [1 ]
Imran, Ali Shariq [1 ]
Mujtaba, Ghulam [2 ]
Yamin, Muhammad Mudassar [3 ]
Hashmi, Ehtesham [3 ]
Cheikh, Faouzi Alaya [1 ]
Beghdadi, Azeddine [1 ,4 ]
机构
[1] Norwegian Univ Sci & Technol NTNU, Intelligent Syst & Analyt ISA Res Grp, Dept Comp Sci IDI, N-2815 Gjovik, Norway
[2] Sukkur IBA Univ, Dept Comp Sci, Sukkur 65200, Pakistan
[3] NTNU Norway, Dept Informat Secur & Commun Technol, Trondheim, Norway
[4] Univ Sorbonne Paris Nord, Paris, France
关键词
Diffusion model; self-supervised learning; attention mechanism; facial emotion recognition;
D O I
10.1109/ICIP51287.2024.10648251
中图分类号
学科分类号
摘要
In this paper, we introduced a novel Facial Emotion Recognition (FER) framework that utilizes a diffusion-based approach and an attention mechanism. The model is efficiently trained through self-supervised learning, leveraging labeled and unlabelled data. The proposed framework has been rigorously tested on the FER2013 and AffectNet datasets, achieving promising accuracies of 67.2% and 68.1%, respectively. The quantitative results not only surpass the performance of existing state-of-the-art FER models but also demonstrate the synergistic effect of combining diffusion-based modeling with self-supervised learning and attention mechanisms within a solid architectural framework. Our approach sets a new benchmark in the field, offering a significant step forward in the accurate and efficient recognition of facial expressions.
引用
收藏
页码:465 / 471
页数:7
相关论文
共 50 条
  • [1] Self-Supervised ECG Representation Learning for Emotion Recognition
    Sarkar, Pritam
    Etemad, Ali
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (03) : 1541 - 1554
  • [2] SPEECH EMOTION RECOGNITION USING SELF-SUPERVISED FEATURES
    Morais, Edmilson
    Hoory, Ron
    Zhu, Weizhong
    Gat, Itai
    Damasceno, Matheus
    Aronowitz, Hagai
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 6922 - 6926
  • [3] SPEAKER NORMALIZATION FOR SELF-SUPERVISED SPEECH EMOTION RECOGNITION
    Gat, Itai
    Aronowitz, Hagai
    Zhu, Weizhong
    Morais, Edmilson
    Hoory, Ron
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7342 - 7346
  • [4] GANSER: A Self-Supervised Data Augmentation Framework for EEG-Based Emotion Recognition
    Zhang, Zhi
    Liu, Yan
    Zhong, Sheng-hua
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2048 - 2063
  • [5] Facial Emotion Recognition with Inter-Modality-Attention-Transformer-Based Self-Supervised Learning
    Chaudhari, Aayushi
    Bhatt, Chintan
    Krishna, Achyut
    Travieso-Gonzalez, Carlos M.
    ELECTRONICS, 2023, 12 (02)
  • [6] Self-supervised utterance order prediction for emotion recognition in conversations
    Jiang, Dazhi
    Liu, Hao
    Tu, Geng
    Wei, Runguo
    Cambria, Erik
    NEUROCOMPUTING, 2024, 577
  • [7] Self-Supervised EEG Emotion Recognition Models Based on CNN
    Wang, Xingyi
    Ma, Yuliang
    Cammon, Jared
    Fang, Feng
    Gao, Yunyuan
    Zhang, Yingchun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 1952 - 1962
  • [8] Self-Supervised EEG Representation Learning for Robust Emotion Recognition
    Liu, Huan
    Zhang, Yuzhe
    Chen, Xuxu
    Zhang, Dalin
    Li, Rui
    Qin, Tao
    ACM TRANSACTIONS ON SENSOR NETWORKS, 2024, 20 (05)
  • [9] SELF-SUPERVISED LEARNING FOR ECG-BASED EMOTION RECOGNITION
    Sarkar, Pritam
    Etemad, Ali
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3217 - 3221
  • [10] Evaluating Self-Supervised Speech Representations for Speech Emotion Recognition
    Atmaja, Bagus Tris
    Sasou, Akira
    IEEE ACCESS, 2022, 10 : 124396 - 124407