A SELF-SUPERVISED DIFFUSION FRAMEWORK FOR FACIAL EMOTION RECOGNITION

被引:0
|
作者
Hassan, Saif [1 ,2 ]
Ullah, Mohib [1 ]
Imran, Ali Shariq [1 ]
Mujtaba, Ghulam [2 ]
Yamin, Muhammad Mudassar [3 ]
Hashmi, Ehtesham [3 ]
Cheikh, Faouzi Alaya [1 ]
Beghdadi, Azeddine [1 ,4 ]
机构
[1] Norwegian Univ Sci & Technol NTNU, Intelligent Syst & Analyt ISA Res Grp, Dept Comp Sci IDI, N-2815 Gjovik, Norway
[2] Sukkur IBA Univ, Dept Comp Sci, Sukkur 65200, Pakistan
[3] NTNU Norway, Dept Informat Secur & Commun Technol, Trondheim, Norway
[4] Univ Sorbonne Paris Nord, Paris, France
关键词
Diffusion model; self-supervised learning; attention mechanism; facial emotion recognition;
D O I
10.1109/ICIP51287.2024.10648251
中图分类号
学科分类号
摘要
In this paper, we introduced a novel Facial Emotion Recognition (FER) framework that utilizes a diffusion-based approach and an attention mechanism. The model is efficiently trained through self-supervised learning, leveraging labeled and unlabelled data. The proposed framework has been rigorously tested on the FER2013 and AffectNet datasets, achieving promising accuracies of 67.2% and 68.1%, respectively. The quantitative results not only surpass the performance of existing state-of-the-art FER models but also demonstrate the synergistic effect of combining diffusion-based modeling with self-supervised learning and attention mechanisms within a solid architectural framework. Our approach sets a new benchmark in the field, offering a significant step forward in the accurate and efficient recognition of facial expressions.
引用
收藏
页码:465 / 471
页数:7
相关论文
共 50 条
  • [41] Masked self-supervised pre-training model for EEG-based emotion recognition
    Hu, Xinrong
    Chen, Yu
    Yan, Jinlin
    Wu, Yuan
    Ding, Lei
    Xu, Jin
    Cheng, Jun
    COMPUTATIONAL INTELLIGENCE, 2024, 40 (03)
  • [42] Cross-Corpus Training Strategy for Speech Emotion Recognition Using Self-Supervised Representations
    Pastor, Miguel A.
    Ribas, Dayana
    Ortega, Alfonso
    Miguel, Antonio
    Lleida, Eduardo
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [43] Audio-Based Emotion Recognition Using Self-Supervised Learning on an Engineered Feature Space
    Nimitsurachat, Peranut
    Washington, Peter
    AI, 2024, 5 (01) : 195 - 207
  • [44] HiCMAE: Hierarchical Contrastive Masked Autoencoder for self-supervised Audio-Visual Emotion Recognition
    Sun, Licai
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    INFORMATION FUSION, 2024, 108
  • [45] SS-EMERGE - self-supervised enhancement for multidimension emotion recognition using GNNs for EEG
    Chirag Ahuja
    Divyashikha Sethia
    Scientific Reports, 15 (1)
  • [46] Self-supervised Deformation Modeling for Facial Expression Editing
    Athar, ShahRukh
    Shu, Zhixin
    Samaras, Dimitris
    2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 294 - 301
  • [47] ON THE CONVERGENCE OF A SELF-SUPERVISED VOWEL RECOGNITION SYSTEM
    PATHAK, A
    PAL, SK
    PATTERN RECOGNITION, 1987, 20 (02) : 237 - 244
  • [48] SVFAP: Self-Supervised Video Facial Affect Perceiver
    Sun, Licai
    Lian, Zheng
    Wang, Kexin
    He, Yu
    Xu, Mingyu
    Sun, Haiyang
    Liu, Bin
    Tao, Jianhua
    IEEE Transactions on Affective Computing, 2025, 16 (01): : 405 - 422
  • [49] A Self-Supervised Learning Framework for Sequential Recommendation
    Jia, Renqi
    Bai, Xu
    Zhou, Xiaofei
    Pan, Shirui
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [50] A framework for self-supervised federated domain adaptation
    Bin Wang
    Gang Li
    Chao Wu
    WeiShan Zhang
    Jiehan Zhou
    Ye Wei
    EURASIP Journal on Wireless Communications and Networking, 2022