Audio-visual stimulation based emotion classification by correlated EEG channels

被引:18
|
作者
Ahirwal, Mitul Kumar [1 ]
Kose, Mangesh Ramaji [2 ]
机构
[1] Maulana Azad Natl Inst Technol, Bhopal 462003, MP, India
[2] Natl Inst Technol, Raipur 492010, Madhya Pradesh, India
关键词
EEG signals; Emotion classification; Channel selection; Channel correlation; Feature extraction; FEATURE-SELECTION; RECOGNITION; SIGNALS; ENTROPY;
D O I
10.1007/s12553-019-00394-5
中图分类号
R-058 [];
学科分类号
摘要
In this paper, a new channel selection technique is presented for emotion classification by electroencephalography (EEG) signals. Audio-visual stimulation is used to generate emotions at the time of experiment. After recording of EEG signals, feature extraction and classification has been applied to classify the emotions (happy, angry, sad and relaxing). The main highlights of the study include: 1) identification/characterization of audio-visual stimulation which generate harmful emotions and 2) proposed approach to reduce the number of EEG channels for emotion classification. Intention behind identification of audio-visual stimulation (video) responsible for harmful emotions like sad and anger is to control their access over social media and another public platform. EEG channels are selected on the basis of their activation probability, calculated from the correlation matrix of EEG channels. Three types of features are extracted from EEG signals, time domain, frequency domain and entropy based. After feature extraction three different algorithms, support vector machine (SVM), artificial neural network (ANN) and naive bayes (NB) are used to classify the emotions. This study is conducted over the DEAP (Database for emotion analysis using Physiological signals) database of EEG signals recorded at different emotional states of several subjects. To compare performance after channel selection, parameters like accuracy, average precision and average recall are calculated. After result analysis, ANN is found as best classifier with 97.74% average accuracy. Among listed features, entropy-based features are found as best features with 90.53% average accuracy.
引用
收藏
页码:7 / 23
页数:17
相关论文
共 50 条
  • [1] Audio-visual stimulation based emotion classification by correlated EEG channels
    Mitul Kumar Ahirwal
    Mangesh Ramaji Kose
    [J]. Health and Technology, 2020, 10 : 7 - 23
  • [2] Direct effects of audio-visual stimulation on EEG
    Teplan, M.
    Krakovska, A.
    Stolc, S.
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2011, 102 (01) : 17 - 24
  • [3] EEG responses to long-term audio-visual stimulation
    Teplan, M
    Krakovská, A
    Stolc, S
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2006, 59 (02) : 81 - 90
  • [4] Phase Synchronization in Human EEG During Audio-Visual Stimulation
    Teplan, M.
    Susmakova, K.
    Palus, M.
    Vejmelka, M.
    [J]. ELECTROMAGNETIC BIOLOGY AND MEDICINE, 2009, 28 (01) : 80 - 84
  • [5] Investigation of human state classification via EEG signals elicited by emotional audio-visual stimulation
    Lee, Wonyoung
    Son, Guiyoung
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (29) : 73217 - 73231
  • [6] Audio-visual based emotion recognition - A new approach
    Song, ML
    Bu, JJ
    Chen, C
    Li, N
    [J]. PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, 2004, : 1020 - 1025
  • [7] Deep emotion recognition based on audio-visual correlation
    Hajarolasvadi, Noushin
    Demirel, Hasan
    [J]. IET COMPUTER VISION, 2020, 14 (07) : 517 - 527
  • [8] Measures of EEG in the context of long-term audio-visual stimulation
    Teplan, M
    Krakovská, A
    Stolc, S
    [J]. Measurement 2005, Proceedings, 2005, : 225 - 228
  • [9] Audio-visual spontaneous emotion recognition
    Zeng, Zhihong
    Hu, Yuxiao
    Roisman, Glenn I.
    Wen, Zhen
    Fu, Yun
    Huang, Thomas S.
    [J]. ARTIFICIAL INTELLIGENCE FOR HUMAN COMPUTING, 2007, 4451 : 72 - +
  • [10] Audio-visual integration of emotion expression
    Collignon, Olivier
    Girard, Simon
    Gosselin, Frederic
    Roy, Sylvain
    Saint-Amour, Dave
    Lassonde, Maryse
    Lepore, Franco
    [J]. BRAIN RESEARCH, 2008, 1242 : 126 - 135