A SELF-SUPERVISED DIFFUSION FRAMEWORK FOR FACIAL EMOTION RECOGNITION

被引:0
|
作者
Hassan, Saif [1 ,2 ]
Ullah, Mohib [1 ]
Imran, Ali Shariq [1 ]
Mujtaba, Ghulam [2 ]
Yamin, Muhammad Mudassar [3 ]
Hashmi, Ehtesham [3 ]
Cheikh, Faouzi Alaya [1 ]
Beghdadi, Azeddine [1 ,4 ]
机构
[1] Norwegian Univ Sci & Technol NTNU, Intelligent Syst & Analyt ISA Res Grp, Dept Comp Sci IDI, N-2815 Gjovik, Norway
[2] Sukkur IBA Univ, Dept Comp Sci, Sukkur 65200, Pakistan
[3] NTNU Norway, Dept Informat Secur & Commun Technol, Trondheim, Norway
[4] Univ Sorbonne Paris Nord, Paris, France
关键词
Diffusion model; self-supervised learning; attention mechanism; facial emotion recognition;
D O I
10.1109/ICIP51287.2024.10648251
中图分类号
学科分类号
摘要
In this paper, we introduced a novel Facial Emotion Recognition (FER) framework that utilizes a diffusion-based approach and an attention mechanism. The model is efficiently trained through self-supervised learning, leveraging labeled and unlabelled data. The proposed framework has been rigorously tested on the FER2013 and AffectNet datasets, achieving promising accuracies of 67.2% and 68.1%, respectively. The quantitative results not only surpass the performance of existing state-of-the-art FER models but also demonstrate the synergistic effect of combining diffusion-based modeling with self-supervised learning and attention mechanisms within a solid architectural framework. Our approach sets a new benchmark in the field, offering a significant step forward in the accurate and efficient recognition of facial expressions.
引用
收藏
页码:465 / 471
页数:7
相关论文
共 50 条
  • [31] Self-supervised group meiosis contrastive learning for EEG-based emotion recognition
    Kan, Haoning
    Yu, Jiale
    Huang, Jiajin
    Liu, Zihe
    Wang, Heqian
    Zhou, Haiyan
    APPLIED INTELLIGENCE, 2023, 53 (22) : 27207 - 27225
  • [32] Self-supervised group meiosis contrastive learning for EEG-based emotion recognition
    Haoning Kan
    Jiale Yu
    Jiajin Huang
    Zihe Liu
    Heqian Wang
    Haiyan Zhou
    Applied Intelligence, 2023, 53 : 27207 - 27225
  • [33] Multi-corpus Affect Recognition with Emotion Embeddings and Self-Supervised Representations of Speech
    Alisamir, Sina
    Ringeval, Fabien
    Portet, Francois
    2022 10TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2022,
  • [34] A contrastive self-supervised learning method for source-free EEG emotion recognition
    Wang, Yingdong
    Ruan, Qunsheng
    Wu, Qingfeng
    Wang, Shuocheng
    USER MODELING AND USER-ADAPTED INTERACTION, 2025, 35 (01)
  • [35] Knowledge-Driven Self-Supervised Representation Learning for Facial Action Unit Recognition
    Chang, Yanan
    Wang, Shangfei
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20385 - 20394
  • [36] Self-Supervised Learning of Person-Specific Facial Dynamics for Automatic Personality Recognition
    Song, Siyang
    Jaiswal, Shashank
    Sanchez, Enrique
    Tzimiropoulos, Georgios
    Shen, Linlin
    Valstar, Michel
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (01) : 178 - 195
  • [37] Rethinking Pseudo-Labeling for Semi-Supervised Facial Expression Recognition With Contrastive Self-Supervised Learning
    Fang, Bei
    Li, Xian
    Han, Guangxin
    He, Juhou
    IEEE ACCESS, 2023, 11 : 45547 - 45558
  • [38] Supervised and Self-Supervised Learning for Assembly Line Action Recognition
    Indris, Christopher
    Ibrahim, Fady
    Ibrahem, Hatem
    Bramesfeld, Gotz
    Huo, Jie
    Ahmad, Hafiz Mughees
    Hayat, Syed Khizer
    Wang, Guanghui
    JOURNAL OF IMAGING, 2025, 11 (01)
  • [39] HiCMAE: Hierarchical Contrastive Masked Autoencoder for self-supervised Audio-Visual Emotion Recognition
    Sun, Licai
    Lian, Zheng
    Liu, Bin
    Tao, Jianhua
    Information Fusion, 2024, 108
  • [40] Self-supervised facial asymmetry learning for automatic evaluation of facial paralysis
    Sun H.
    Li M.
    Zhang P.
    Xu P.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2021, 48 (03): : 115 - 122and154