Classifying human emotions in HRI: applying global optimization model to EEG brain signals

被引:2
|
作者
Staffa, Mariacarla [1 ]
D'Errico, Lorenzo [2 ]
Sansalone, Simone [3 ]
Alimardani, Maryam [4 ]
机构
[1] Univ Naples Parthenope, Dept Sci & Technol, Naples, Italy
[2] Univ Naples Federico II, Dept Elect Engn & Informat Technol, Naples, Italy
[3] Univ Naples Federico II, Dept Phys, Naples, Italy
[4] Tilburg Univ, Dept Cognit Sci & Artificial Intelligence, Tilburg, Netherlands
关键词
human-robot interaction (HRI); EEG signals; brain-computer interface (BCI); frontal brain asymmetry (FBA); Theory of Mind (ToM); Global Optimization Model (GOM); machine learning; deep learning; RECOGNITION; ASYMMETRY; STRESS;
D O I
10.3389/fnbot.2023.1191127
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Significant efforts have been made in the past decade to humanize both the form and function of social robots to increase their acceptance among humans. To this end, social robots have recently been combined with brain-computer interface (BCI) systems in an attempt to give them an understanding of human mental states, particularly emotions. However, emotion recognition using BCIs poses several challenges, such as subjectivity of emotions, contextual dependency, and a lack of reliable neuro-metrics for real-time processing of emotions. Furthermore, the use of BCI systems introduces its own set of limitations, such as the bias-variance trade-off, dimensionality, and noise in the input data space. In this study, we sought to address some of these challenges by detecting human emotional states from EEG brain activity during human-robot interaction (HRI). EEG signals were collected from 10 participants who interacted with a Pepper robot that demonstrated either a positive or negative personality. Using emotion valence and arousal measures derived from frontal brain asymmetry (FBA), several machine learning models were trained to classify human's mental states in response to the robot personality. To improve classification accuracy, all proposed classifiers were subjected to a Global Optimization Model (GOM) based on feature selection and hyperparameter optimization techniques. The results showed that it is possible to classify a user's emotional responses to the robot's behavior from the EEG signals with an accuracy of up to 92%. The outcome of the current study contributes to the first level of the Theory of Mind (ToM) in Human-Robot Interaction, enabling robots to comprehend users' emotional responses and attribute mental states to them. Our work advances the field of social and assistive robotics by paving the way for the development of more empathetic and responsive HRI in the future.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Study of the EEG Signals of Human Brain for the Analysis of Emotions
    Panat, Ashish R.
    Patil, Anita S.
    [J]. ADVANCES IN COMPUTING AND INFORMATION TECHNOLOGY, VOL 2, 2013, 177 : 659 - +
  • [2] Can a robot elicit emotions? A Global Optimization Model to attribute mental states to human users in HRI
    Staffa, Mariacarla
    D'Errico, Lorenzo
    [J]. 2023 32ND IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION, RO-MAN, 2023, : 863 - 868
  • [3] Combining Spatial Filtering and Wavelet Transform for Classifying Human Emotions Using EEG Signals
    Murugappan, Murugappan
    Nagarajan, Ramachandran
    Yaacob, Sazali
    [J]. JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2011, 31 (01) : 45 - 51
  • [4] BUSINESS SUCCESS THROUGH UNDERSTANDING HUMAN EMOTIONS: CASE STUDY OF CLASSIFYING EMOTIONS USING THE BRAIN WAIVES EEG DATA
    Peesari, Rohith Reddy
    Fiaidhi, Jinan
    Mohammed, Sabah
    [J]. INTERNATIONAL JOURNAL OF DISASTER RECOVERY AND BUSINESS CONTINUITY, 2019, 10 : 7 - 18
  • [5] Recognition of human emotions using EEG signals: A review
    Rahman, Md. Mustafizur
    Sarkar, Ajay Krishno
    Hossain, Md. Amzad
    Hossain, Md. Selim
    Islam, Md. Rabiul
    Hossain, Md. Biplob
    Quinn, Julian M. W.
    Moni, Mohammad Ali
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 136
  • [6] New method of classifying eeg signals in brain-computer interfaces
    Tang, Yan
    Liu, Jian-Xin
    Gong, An-Dong
    [J]. Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2009, 38 (06): : 1034 - 1038
  • [7] Neuro-Emotional Mapping of Human Emotions via EEG Signals
    Kumar, Deepak
    Singh, Pradeep
    Kumar, Ashutosh
    Ghosh, Sutirtha
    Raman, Balasubramanian
    [J]. 2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,
  • [8] A Brain Computer Interface by EEG Signals from Self-induced Emotions
    Di Giamberardino, Paolo
    Iacoviello, Daniela
    Placidi, Giuseppe
    Polsinelli, Matteo
    Spezialetti, Matteo
    [J]. VIPIMAGE 2017, 2018, 27 : 713 - 721
  • [9] Gated Transformer for Decoding Human Brain EEG Signals
    Tao, Yunzhe
    Sun, Tao
    Muhamed, Aashiq
    Genc, Sahika
    Jackson, Dylan
    Arsanjani, Ali
    Yaddanapudi, Suri
    Li, Liang
    Kumar, Prachi
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 125 - 130
  • [10] Applying evolution strategies to preprocessing EEG signals for brain-computer interfaces
    Aler, Ricardo
    Galvan, Ines M.
    Valls, Jose M.
    [J]. INFORMATION SCIENCES, 2012, 215 : 53 - 66