Realtime Emotional Reflective User Interface Based on Deep Convolutional Neural Networks and Generative Adversarial Networks

被引:4
|
作者
Burrows, Holly [1 ]
Zarrin, Javad [1 ]
Babu-Saheer, Lakshmi [1 ]
Maktab-Dar-Oghaz, Mahdi [1 ]
机构
[1] Anglia Ruskin Univ, Sch Comp & Informat Sci, East Rd, Cambridge CB1 1PT, England
关键词
emotion recognition; deep learning; CNN; GAN; intelligent user interface; human computer interaction; mental health;
D O I
10.3390/electronics11010118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is becoming increasingly apparent that a significant amount of the population suffers from mental health problems, such as stress, depression, and anxiety. These issues are a result of a vast range of factors, such as genetic conditions, social circumstances, and lifestyle influences. A key cause, or contributor, for many people is their work; poor mental state can be exacerbated by jobs and a person's working environment. Additionally, as the information age continues to burgeon, people are increasingly sedentary in their working lives, spending more of their days seated, and less time moving around. It is a well-known fact that a decrease in physical activity is detrimental to mental well-being. Therefore, the need for innovative research and development to combat negativity early is required. Implementing solutions using Artificial Intelligence has great potential in this field of research. This work proposes a solution to this problem domain, utilising two concepts of Artificial Intelligence, namely, Convolutional Neural Networks and Generative Adversarial Networks. A CNN is trained to accurately predict when an individual is experiencing negative emotions, achieving a top accuracy of 80.38% with a loss of 0.42. A GAN is trained to synthesise images from an input domain that can be attributed to evoking position emotions. A Graphical User Interface is created to display the generated media to users in order to boost mood and reduce feelings of stress. The work demonstrates the capability for using Deep Learning to identify stress and negative mood, and the strategies that can be implemented to reduce them.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] LEARNING REPRESENTATIONS OF EMOTIONAL SPEECH WITH DEEP CONVOLUTIONAL GENERATIVE ADVERSARIAL NETWORKS
    Chang, Jonathan
    Scherer, Stefan
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2746 - 2750
  • [2] Convolutional and generative adversarial neural networks in manufacturing
    Kusiak, Andrew
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2020, 58 (05) : 1594 - 1604
  • [3] Supervised deep convolutional generative adversarial networks
    Ocal, Abdurrahman
    Ozbakir, Lale
    NEUROCOMPUTING, 2021, 449 : 389 - 398
  • [4] Spectrum sensing based on deep convolutional generative adversarial networks
    Liu, Zheng
    Jing, Xiaojun
    Zhang, Ronghui
    Mu, Junsheng
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 796 - 801
  • [5] ECG Reconstruction Based on Improved Deep Convolutional Generative Adversarial Networks
    ZHAO Yaqin
    SUN Ruirui
    WU Longwen
    NIE Yuting
    HE Shengyang
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (01) : 59 - 69
  • [6] Logo recognition of vehicles based on deep convolutional generative adversarial networks
    Ma, Huan
    Han, Yunfei
    JOURNAL OF MEASUREMENTS IN ENGINEERING, 2024, 12 (02) : 353 - 365
  • [7] ECG Reconstruction Based on Improved Deep Convolutional Generative Adversarial Networks
    Zhao, Yaqin
    Sun, Ruirui
    Wu, Longwen
    Nie, Yuting
    He, Shengyang
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2022, 44 (01): : 59 - 69
  • [8] FD Technology for HSs based on Deep Convolutional Generative Adversarial Networks
    Wang, Jun
    Wang, Yuanxi
    INTERNATIONAL ARAB JOURNAL OF INFORMATION TECHNOLOGY, 2024, 21 (02) : 299 - 312
  • [9] Improving Error Related Potential Classification by using Generative Adversarial Networks and Deep Convolutional Neural Networks
    Gao, Chenguang
    Li, Zhao
    Ora, Hiroki
    Miyake, Yoshihiro
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 2468 - 2476
  • [10] Generalization of Convolutional Neural Networks for ECG Classification Using Generative Adversarial Networks
    Shaker, Abdelrahman M.
    Tantawi, Manal
    Shedeed, Howida A.
    Tolba, Mohamed F.
    IEEE ACCESS, 2020, 8 : 35592 - 35605