Acoustic feature-based emotion recognition and curing using ensemble learning and CNN

被引:0
|
作者
Anand, Raghav, V [1 ]
Md, Abdul Quadir [1 ]
Sakthivel, G. [1 ]
Padmavathy, T., V [1 ]
Mohan, Senthilkumar [2 ]
Damasevicius, Robertas [3 ]
机构
[1] Vellore Inst Technol, Sch Comp Sci Engn, Chennai 600127, India
[2] Vellore Inst Technol, Sch Informat Technol & Engn, Vellore 632014, India
[3] Kaunas Univ Technol, Dept Software Engn, Kaunas, Lithuania
关键词
Emotion recognition; Acoustic features; Signal processing; Random forest classifier; XG Boost classifier; Convolutional neural network; Ensemble algorithm;
D O I
10.1016/j.asoc.2024.112151
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition and understanding plays a crucial role in various domains, including healthcare, human- computer interaction, and mental well-being. In this context, this paper proposes a methodology for recognizing and curing emotions using acoustic features and machine learning algorithms. The approach involves extracting acoustic features from the signals using diverse signal processing techniques. These features are then utilized as inputs for machine learning and deep learning algorithms, including the Random Forest classifier, XG Boost classifier, Convolutional Neural Network (CNN), and an ensemble algorithm. The ensemble algorithm combines Random Forest and XG Boost as base classifiers, with the Na & iuml;ve Bayes algorithm serving as the meta classifier. We also propose a novel model that generates personalized curing strategies for individuals based on emotion recognition, so they can keep their emotional state positive. With the help of an ensemble learning model the proposed model achieved an emotion recognition accuracy of 92 % by combining three publicly available datasets containing emotional speech recordings. In the neutral and positive emotion classifications, the Receiver Operating Characteristic curve (ROC) had a 98 % accuracy rate while negative emotion classifications had a 91 % true positive rate. The effectiveness of the proposed curing methodology model has also been demonstrated by conducting experiments on a group of individuals and comparing the results with a state-of-theart Generative Pre-Trained Transformer-3 (GPT-3) and ChatGPT, it was inferred that 89.35 % of the test group preferred the responses of the proposed curing model, over the GPT models The results of our experiments show that our proposed methodology can significantly boost the emotional state of an individual, thereby highlighting its potential for use in clinical settings.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] DHERF: A Deep Learning Ensemble Feature Extraction Framework for Emotion Recognition Using Enhanced-CNN
    Basha, Shaik Abdul Khalandar
    Vincent, P. M. Durai Raj
    [J]. JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (07) : 853 - 861
  • [2] CNN and LSTM based ensemble learning for human emotion recognition using EEG recordings
    Iyer, Abhishek
    Das, Srimit Sritik
    Teotia, Reva
    Maheshwari, Shishir
    Sharma, Rishi Raj
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (04) : 4883 - 4896
  • [3] CNN and LSTM based ensemble learning for human emotion recognition using EEG recordings
    Abhishek Iyer
    Srimit Sritik Das
    Reva Teotia
    Shishir Maheshwari
    Rishi Raj Sharma
    [J]. Multimedia Tools and Applications, 2023, 82 : 4883 - 4896
  • [4] A novel speech emotion recognition method based on feature construction and ensemble learning
    Guo, Yi
    Xiong, Xuejun
    Liu, Yangcheng
    Xu, Liang
    Li, Qiong
    [J]. PLOS ONE, 2022, 17 (08):
  • [5] Ensemble Learning with CNN-LSTM Combination for Speech Emotion Recognition
    Tanberk, Senem
    Tukel, Dilek Bilgin
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTING AND COMMUNICATION NETWORKS (ICCCN 2021), 2022, 394 : 39 - 47
  • [6] Emotion Recognition Based on Dynamic Ensemble Feature Selection
    Yang, Yong
    Wang, Guoyin
    Kong, Hao
    [J]. MAN-MACHINE INTERACTIONS, 2009, 59 : 217 - 225
  • [7] Ensemble Learning of Hybrid Acoustic Features for Speech Emotion Recognition
    Zvarevashe, Kudakwashe
    Olugbara, Oludayo
    [J]. ALGORITHMS, 2020, 13 (03)
  • [8] Facial landmark detection and geometric feature-based emotion recognition
    Shanthi, P.
    Nickolas, S.
    [J]. INTERNATIONAL JOURNAL OF BIOMETRICS, 2022, 14 (02) : 138 - 154
  • [9] An Acoustic Feature-Based Deep Learning Model for Automatic Thai Vowel Pronunciation Recognition
    Rukwong, Niyada
    Pongpinigpinyo, Sunee
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (13):
  • [10] CLSTM: Deep Feature-Based Speech Emotion Recognition Using the Hierarchical ConvLSTM Network
    Mustageem
    Kwon, Soonil
    [J]. MATHEMATICS, 2020, 8 (12) : 1 - 19