A Deep Quantum Convolutional Neural Network Based Facial Expression Recognition For Mental Health Analysis

被引:0
|
作者
Hossain, Sanoar [1 ]
Umer, Saiyed [1 ]
Rout, Ranjeet Kumar [2 ]
Al Marzouqi, Hasan [3 ]
机构
[1] Aliah Univ, Dept Comp Sci & Engn, Kolkata 700156, India
[2] Natl Inst Technol Srinagar, Dept Comp Sci & Engn, Srinagar 190006, Jammu & Kashmir, India
[3] Khalifa Univ Sci & Technol, Dept Elect Engn & Comp Sci, Abu Dhabi, U Arab Emirates
关键词
Face recognition; Convolutional neural networks; Feature extraction; Emotion recognition; Computational modeling; Quantum computing; Integrated circuit modeling; Facial expression; recognition; quantum; convolutional neural network; quanvolutional; quantum variational circuit; mental health conditions;
D O I
10.1109/TNSRE.2024.3385336
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The purpose of this work is to analyze how new technologies can enhance clinical practice while also examining the physical traits of emotional expressiveness of face expression in a number of psychiatric illnesses. Hence, in this work, an automatic facial expression recognition system has been proposed that analyzes static, sequential, or video facial images from medical healthcare data to detect emotions in people's facial regions. The proposed method has been implemented in five steps. The first step is image preprocessing, where a facial region of interest has been segmented from the input image. The second component includes a classical deep feature representation and the quantum part that involves successive sets of quantum convolutional layers followed by random quantum variational circuits for feature learning. Here, the proposed system has attained a faster training approach using the proposed quantum convolutional neural network approach that takes O(log (n)). In contrast, the classical convolutional neural network models have O(n(2)) time. Additionally, some performance improvement techniques, such as image augmentation, fine-tuning, matrix normalization, and transfer learning methods, have been applied to the recognition system. Finally, the scores due to classical and quantum deep learning models are fused to improve the performance of the proposed method. Extensive experimentation with Karolinska-directed emotional faces (KDEF), Static Facial Expressions in the Wild (SFEW 2.0), and Facial Expression Recognition 2013 (FER-2013) benchmark databases and compared with other state-of-the-art methods that show the improvement of the proposed system.
引用
收藏
页码:1556 / 1565
页数:10
相关论文
共 50 条
  • [1] Facial expression recognition based on deep convolutional neural network
    Wang, Kejun
    Chen, Jing
    Zhang, Xinyi
    Sun, Liying
    [J]. 2018 IEEE 8TH ANNUAL INTERNATIONAL CONFERENCE ON CYBER TECHNOLOGY IN AUTOMATION, CONTROL, AND INTELLIGENT SYSTEMS (IEEE-CYBER), 2018, : 629 - 634
  • [2] Deep Convolutional Neural Network for Facial Expression Recognition
    Zhai, Yikui
    Liu, Jian
    Zeng, Junying
    Piuri, Vincenzo
    Scotti, Fabio
    Ying, Zilu
    Xu, Ying
    Gan, Junying
    [J]. IMAGE AND GRAPHICS (ICIG 2017), PT I, 2017, 10666 : 211 - 223
  • [3] Facial Expression Recognition Based on Convolutional Neural Network
    Zhou Yue
    Feng Yanyan
    Zeng Shangyou
    Pan Bing
    [J]. PROCEEDINGS OF 2019 IEEE 10TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2019), 2019, : 410 - 413
  • [4] Deep Convolutional Neural Network for Facial Expression Recognition using Facial Parts
    Nwosu, Lucy
    Wang, Hui
    Lu, Jiang
    Unwala, Ishaq
    Yang, Xiaokun
    Zhang, Ting
    [J]. 2017 IEEE 15TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 15TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 3RD INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS(DASC/PICOM/DATACOM/CYBERSCI, 2017, : 1318 - 1321
  • [5] Fly facial recognition based on deep convolutional neural network
    Chen, Yan-Tong
    Chen, Wei-Nan
    Zhang, Xian-Zhong
    Li, Yu-Yang
    Wang, Jun-Sheng
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2020, 28 (07): : 1558 - 1567
  • [6] Automatic Facial Expression Recognition Based on a Deep Convolutional-Neural-Network Structure
    Shan, Ke
    Guo, Junqi
    You, Wenwan
    Lu, Di
    Bie, Rongfang
    [J]. 2017 IEEE/ACIS 15TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING RESEARCH, MANAGEMENT AND APPLICATIONS (SERA), 2017, : 123 - 128
  • [7] Facial Expression Recognition Based on Deep Binary Convolutional Network
    Zhou, Lifang
    Liu, Junlin
    Li, Weisheng
    Mi, Jianxun
    Lei, Bangjun
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (03): : 425 - 436
  • [8] Facial expression recognition based on VGGNet convolutional neural network
    He Jun
    Li Shuai
    Shen Jinming
    Liu Yue
    Wang Jingwei
    Jin Peng
    [J]. 2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 4146 - 4151
  • [9] Efficient facial expression recognition based on convolutional neural network
    Cai, Yongxiang
    Gao, Jingwen
    Zhang, Gen
    Liu, Yuangang
    [J]. INTELLIGENT DATA ANALYSIS, 2021, 25 (01) : 139 - 154
  • [10] Facial Expression Recognition Based on Improved Convolutional Neural Network
    Siyuan, Liu
    Libiao, Wang
    Yuzhen, Zheng
    [J]. Journal of Engineering Science and Technology Review, 2023, 16 (01) : 61 - 67