Realtime Emotional Reflective User Interface Based on Deep Convolutional Neural Networks and Generative Adversarial Networks

被引:4
|
作者
Burrows, Holly [1 ]
Zarrin, Javad [1 ]
Babu-Saheer, Lakshmi [1 ]
Maktab-Dar-Oghaz, Mahdi [1 ]
机构
[1] Anglia Ruskin Univ, Sch Comp & Informat Sci, East Rd, Cambridge CB1 1PT, England
关键词
emotion recognition; deep learning; CNN; GAN; intelligent user interface; human computer interaction; mental health;
D O I
10.3390/electronics11010118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is becoming increasingly apparent that a significant amount of the population suffers from mental health problems, such as stress, depression, and anxiety. These issues are a result of a vast range of factors, such as genetic conditions, social circumstances, and lifestyle influences. A key cause, or contributor, for many people is their work; poor mental state can be exacerbated by jobs and a person's working environment. Additionally, as the information age continues to burgeon, people are increasingly sedentary in their working lives, spending more of their days seated, and less time moving around. It is a well-known fact that a decrease in physical activity is detrimental to mental well-being. Therefore, the need for innovative research and development to combat negativity early is required. Implementing solutions using Artificial Intelligence has great potential in this field of research. This work proposes a solution to this problem domain, utilising two concepts of Artificial Intelligence, namely, Convolutional Neural Networks and Generative Adversarial Networks. A CNN is trained to accurately predict when an individual is experiencing negative emotions, achieving a top accuracy of 80.38% with a loss of 0.42. A GAN is trained to synthesise images from an input domain that can be attributed to evoking position emotions. A Graphical User Interface is created to display the generated media to users in order to boost mood and reduce feelings of stress. The work demonstrates the capability for using Deep Learning to identify stress and negative mood, and the strategies that can be implemented to reduce them.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Seismic facies classification using supervised convolutional neural networks and semisupervised generative adversarial networks
    Liu, Mingliang
    Jervis, Michael
    Li, Weichang
    Nivlet, Philippe
    GEOPHYSICS, 2020, 85 (04) : O47 - O58
  • [42] Using Generative Adversarial Networks and Parameter Optimization of Convolutional Neural Networks for Lung Tumor Classification
    Lin, Chun-Hui
    Lin, Cheng-Jian
    Li, Yu-Chi
    Wang, Shyh-Hau
    APPLIED SCIENCES-BASEL, 2021, 11 (02): : 1 - 17
  • [43] Using Generative Adversarial Networks and Transfer Learning for Breast Cancer Detection by Convolutional Neural Networks
    Guan, Shuyue
    Loew, Murray
    MEDICAL IMAGING 2019: IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS, 2019, 10954
  • [44] Integrated Generative Adversarial Networks and Deep Convolutional Neural Networks for Image Data Classification: A Case Study for COVID-19
    Khalif, Ku Muhammad Naim Ku
    Seng, Woo Chaw
    Gegov, Alexander
    Abu Bakar, Ahmad Syafadhli
    Shahrul, Nur Adibah
    INFORMATION, 2024, 15 (01)
  • [45] User Mobility Synthesis based on Generative Adversarial Networks: A Survey
    Shin, Seungjae
    Jeon, Hongseok
    Cho, Chunglae
    Yoon, Seunghyun
    Kim, Taeyeon
    2020 22ND INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT): DIGITAL SECURITY GLOBAL AGENDA FOR SAFE SOCIETY!, 2020, : 94 - 103
  • [46] A dynamic balanced level generator for video games based on deep convolutional generative adversarial networks
    Rajabi, M.
    Ashtiani, M.
    Minaei-Bidgoli, B.
    Davoodi, O.
    SCIENTIA IRANICA, 2021, 28 (03) : 1497 - 1514
  • [47] A dynamic balanced level generator for video games based on deep convolutional generative adversarial networks
    Rajabi M.
    Ashtiani M.
    Minaei-Bidgoli B.
    Davoodi O.
    Ashtiani, Mehrdad (mashtiani@iust.ac.ir), 1600, Sharif University of Technology (28): : 1497 - 1514
  • [48] Remote sensing image colorization based on Joint Stream Deep Convolutional Generative Adversarial Networks
    Wang, Jingyu
    Nie, Jie
    Chen, Hao
    Xie, Huaxin
    Zheng, Chengyu
    Ye, Min
    Wei, Zhiqiang
    PROCEEDINGS OF THE 4TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA IN ASIA, MMASIA 2022, 2022,
  • [49] A Novel Chaotic Block Image Encryption Algorithm Based on Deep Convolutional Generative Adversarial Networks
    Fang, Pengfei
    Liu, Han
    Wu, Chengmao
    IEEE ACCESS, 2021, 9 : 18497 - 18517
  • [50] Generative adversarial network based synthetic data training model for lightweight convolutional neural networks
    Rather, Ishfaq Hussain
    Kumar, Sushil
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (2) : 6249 - 6271