Classification of emotions induced by music videos and correlation with participants' rating

被引:66
|
作者
Daimi, Syed Naser [1 ]
Saha, Goutam [1 ]
机构
[1] Indian Inst Technol, Dept Elect & Elect Commun Engn, Kharagpur 721302, W Bengal, India
关键词
Dual-Tree Complex Wavelet Packet Transform (DT-CWPT); Electroencephalogram (EEG); Singular Value Decomposition (SVD); QR factorization with column pivoting (QRcp); F-Ratio; Support Vector Machine (SVM); Human-computer interaction (HCI); ELECTROENCEPHALOGRAM EEG; COMPLEX WAVELETS; SIGNALS; BRAIN;
D O I
10.1016/j.eswa.2014.03.050
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotional experience and preference play a vital role in selection of multimedia content for an individual. Brain electrical activity bears the emotional cues needed for emotion detection, but very modest research has been done to extract those cues. This paper presents a novel machine learning approach using Dual-Tree Complex Wavelet Packet Transform (DT-CWPT) time-frequency features from electroencephalogram (EEG) to detect emotions together with an analysis of brain activity in different emotional states. Firstly, DT-CWPT is used to extract time-frequency emotional features. Then non-redundant and most discriminating emotional features are selected through singular value decomposition (SVD), QR factorization with column pivoting (QRcp) and F-Ratio based feature selection (FS) method. The reduced emotional feature set is used to classify emotion using support vector machine (SVM) and validated by leave-one-out cross-validation scheme. Results confirm the robustness and consistency in classification of emotions from EEG signals and significant correlation between participants' self assessed ratings with emotional features. It also gives an analysis of activities in brain region during different emotional states. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:6057 / 6065
页数:9
相关论文
共 50 条
  • [1] Single Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos
    Koelstra, Sander
    Yazdani, Ashkan
    Soleymani, Mohammad
    Muhl, Christian
    Lee, Jong-Seok
    Nijholt, Anton
    Pun, Thierry
    Ebrahimi, Touradj
    Patras, Ioannis
    BRAIN INFORMATICS, BI 2010, 2010, 6334 : 89 - 100
  • [2] Physiological Measures and Subjective Rating of Emotions Induced by Music
    Sokhadze, Guela
    Wheeler, Barbara
    Sokhadze, Estate
    APPLIED PSYCHOPHYSIOLOGY AND BIOFEEDBACK, 2012, 37 (04) : 304 - 304
  • [3] Recognition of Emotions Induced by Music Videos Using DT-CWPT
    Naser, Daimi Syed
    Saha, Goutam
    2013 INDIAN CONFERENCE ON MEDICAL INFORMATICS AND TELEMEDICINE (ICMIT 2013), 2013, : 53 - 57
  • [4] Multimodal Classification of Emotions in Latin Music
    Catharin, Leonardo G.
    Ribeiro, Rafael P.
    Silla Jr, Carlos N.
    Costa, Yandre M. G.
    Feltrim, Valeria D.
    2020 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2020), 2020, : 173 - 180
  • [5] Meta-Emotion: How Films and Music Videos Communicate Emotions About Emotions
    Bartsch, Anne
    PROJECTIONS-THE JOURNAL FOR MOVIES AND MIND, 2008, 2 (01) : 45 - 59
  • [6] Music Videos and Emotions Applied in Learning Spanish as a Foreign Language
    Carmen Sanchez-Vizcaino, M.
    Fonseca Mora, M. Carmen
    CIRCULO DE LINGUISTICA APLICADA A LA COMUNICACION, 2019, (78): : 255 - 286
  • [7] Correlation of printed music sounds with basic emotions
    Izmailov, Ch. A.
    Labkaev, J. Ya.
    Matveeva, L. V.
    Izmailova, N. Ch.
    Koshmarov, A. J.
    PSIKHOLOGICHESKII ZHURNAL, 2006, 27 (04) : 59 - 66
  • [8] Music Emotions Recognition by Cognitive Classification Methodologies
    Bai, Junjie
    Luo, Kan
    Peng, Jun
    Shi, Jinliang
    Wu, Ying
    Feng, Lixiao
    li, Jianqing
    Wang, Yingxu
    2017 IEEE 16TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC), 2017, : 121 - 129
  • [9] Multi-label classification of emotions in music
    Wieczorkowska, Alicja
    Synak, Piotr
    Ras, Zbigniew W.
    INTELLIGENT INFORMATION PROCESSING AND WEB MINING, PROCEEDINGS, 2006, : 307 - +
  • [10] Classification of Music-Induced Emotions Based on Information Fusion of Forehead Biosignals and Electrocardiogram
    Mohsen Naji
    Mohammd Firoozabadi
    Parviz Azadfallah
    Cognitive Computation, 2014, 6 : 241 - 252