Realtime Emotional Reflective User Interface Based on Deep Convolutional Neural Networks and Generative Adversarial Networks

被引:4
|
作者
Burrows, Holly [1 ]
Zarrin, Javad [1 ]
Babu-Saheer, Lakshmi [1 ]
Maktab-Dar-Oghaz, Mahdi [1 ]
机构
[1] Anglia Ruskin Univ, Sch Comp & Informat Sci, East Rd, Cambridge CB1 1PT, England
关键词
emotion recognition; deep learning; CNN; GAN; intelligent user interface; human computer interaction; mental health;
D O I
10.3390/electronics11010118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
It is becoming increasingly apparent that a significant amount of the population suffers from mental health problems, such as stress, depression, and anxiety. These issues are a result of a vast range of factors, such as genetic conditions, social circumstances, and lifestyle influences. A key cause, or contributor, for many people is their work; poor mental state can be exacerbated by jobs and a person's working environment. Additionally, as the information age continues to burgeon, people are increasingly sedentary in their working lives, spending more of their days seated, and less time moving around. It is a well-known fact that a decrease in physical activity is detrimental to mental well-being. Therefore, the need for innovative research and development to combat negativity early is required. Implementing solutions using Artificial Intelligence has great potential in this field of research. This work proposes a solution to this problem domain, utilising two concepts of Artificial Intelligence, namely, Convolutional Neural Networks and Generative Adversarial Networks. A CNN is trained to accurately predict when an individual is experiencing negative emotions, achieving a top accuracy of 80.38% with a loss of 0.42. A GAN is trained to synthesise images from an input domain that can be attributed to evoking position emotions. A Graphical User Interface is created to display the generated media to users in order to boost mood and reduce feelings of stress. The work demonstrates the capability for using Deep Learning to identify stress and negative mood, and the strategies that can be implemented to reduce them.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] The research of virtual face based on Deep Convolutional Generative Adversarial Networks using TensorFlow
    Liu, Shouqiang
    Yu, Mengjing
    Li, Miao
    Xu, Qingzhen
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2019, 521 : 667 - 680
  • [32] Identity-Based Patterns in Deep Convolutional Networks: Generative Adversarial Phonology and Reduplication
    Begus, Gasper
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 : 1180 - 1196
  • [33] A Hybrid Deep Learning Framework to Predict Alzheimer's Disease Progression Using Generative Adversarial Networks and Deep Convolutional Neural Networks
    SinhaRoy, Rajarshi
    Sen, Anupam
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024, 49 (03) : 3267 - 3284
  • [34] A Hybrid Deep Learning Framework to Predict Alzheimer’s Disease Progression Using Generative Adversarial Networks and Deep Convolutional Neural Networks
    Rajarshi SinhaRoy
    Anupam Sen
    Arabian Journal for Science and Engineering, 2024, 49 : 3267 - 3284
  • [35] Robust Iris Segmentation Based on Fully Convolutional Networks and Generative Adversarial Networks
    Bezerra, Cides S.
    Laroca, Rayson
    Lucio, Diego R.
    Severo, Evair
    Oliveira, Lucas F.
    Britto, Alceu S., Jr.
    Menotti, David
    PROCEEDINGS 2018 31ST SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2018, : 281 - 288
  • [36] Deep convolutional generative adversarial networks: performance analysis in wireless systems
    Shams Fardous Arnab
    S. M. Ibnul Ul Alam
    Tasfin Mahmud
    Saifur Rahman Sabuj
    Shakil Ahmed
    Discover Internet of Things, 4 (1):
  • [37] Energy data generation with Wasserstein Deep Convolutional Generative Adversarial Networks
    Li, Jianbin
    Chen, Zhiqiang
    Cheng, Long
    Liu, Xiufeng
    ENERGY, 2022, 257
  • [38] Deep Generative Adversarial Neural Networks for Compressive Sensing MRI
    Mardani, Morteza
    Gong, Enhao
    Cheng, Joseph Y.
    Vasanawala, Shreyas S.
    Zaharchuk, Greg
    Xing, Lei
    Pauly, John M.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (01) : 167 - 179
  • [39] Quality grading of jujubes using composite convolutional neural networks in combination with RGB color space segmentation and deep convolutional generative adversarial networks
    Guo, Zhongyuan
    Zheng, Hong
    Xu, Xiaohang
    Ju, Jianping
    Zheng, Zhaohui
    You, Changhui
    Gu, Yu
    JOURNAL OF FOOD PROCESS ENGINEERING, 2021, 44 (02)
  • [40] Password Guessing Based on Recurrent Neural Networks and Generative Adversarial Networks
    Wang D.
    Zou Y.-K.
    Tao Y.
    Wang B.
    Jisuanji Xuebao/Chinese Journal of Computers, 2021, 44 (08): : 1519 - 1534