Multi-label emotion recognition from Indian classical music using gradient descent SNN model

被引:6
|
作者
Tiple, Bhavana [1 ]
Patwardhan, Manasi [2 ]
机构
[1] Dr Vishwanath Karad MIT World Peace Univ, Sch SCET, Pune, Maharashtra, India
[2] TCS Innovat Labs, Pune, Maharashtra, India
关键词
Convolutional neural network; Spiking neural network; Gradient descent; Temporal; Spectral; Short Term Fourier Transform; SPIKING NEURAL-NETWORK; CLASSIFICATION;
D O I
10.1007/s11042-022-11975-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Music enthusiasts are growing exponentially and based on this, many songs are being introduced to the market and stored in signal music libraries. Due to this development emotion recognition model from music contents has received increasing attention in today's world. Of these technologies, a novel Music Emotion Recognition (MER) system is introduced to meet the ever-increasing demand for easy and efficient access to music information. Even though this system was well-developed it lacks in maintaining accuracy of the system and finds difficulty in predicting multi-label emotion type. To address these shortcomings, in this research article, a novel MER system is developed by inter-linking the pre-processing, feature extraction and classification steps. Initially, pre-processing step is employed to convert larger audio files into smaller audio frames. Afterwards, music related temporal, spectral and energy features are extracted for those pre-processed frames which are subjected to the proposed gradient descent based Spiking Neural Network (SNN) classifier. While learning SNN, it is important to determine the optimal weight values for reducing the training error so that gradient descent optimization approach is adopted. To prove the effectiveness of proposed research, proposed model is compared with conventional classification algorithms. The proposed methodology was experimentally tested using various evaluation metrics and it achieves 94.55% accuracy. Hence the proposed methodology attains a good accuracy measure and outperforms well than other algorithms.
引用
收藏
页码:8853 / 8870
页数:18
相关论文
共 50 条
  • [1] Multi-label emotion recognition from Indian classical music using gradient descent SNN model
    Bhavana Tiple
    Manasi Patwardhan
    Multimedia Tools and Applications, 2022, 81 : 8853 - 8870
  • [2] Multi-label Classifier for Emotion Recognition from Music
    Tomar, Divya
    Agarwal, Sonali
    PROCEEDINGS OF 3RD INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING, NETWORKING AND INFORMATICS (ICACNI 2015), VOL 1, 2016, 43 : 111 - 123
  • [3] Multi-label classification of music by emotion
    Konstantinos Trohidis
    Grigorios Tsoumakas
    George Kalliris
    Ioannis Vlahavas
    EURASIP Journal on Audio, Speech, and Music Processing, 2011
  • [4] Multi-label classification of music by emotion
    Trohidis, Konstantinos
    Tsoumakas, Grigorios
    Kalliris, George
    Vlahavas, Ioannis
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2011, : 1 - 9
  • [5] Speech Emotion Recognition based on Multi-Label Emotion Existence Model
    Ando, Atsushi
    Masumura, Ryo
    Kamiyama, Havana
    Kobashikawa, Satoshi
    Aono, Yushi
    INTERSPEECH 2019, 2019, : 2818 - 2822
  • [6] Emotion and Instrument Recognition from Indian Classical Music Recordings Using Transformers
    Deb, Ahana
    Mahapatra, Ayan Sinha
    Sanyal, Shankha
    Banerjee, Archi
    Nag, Sayan
    Basu, Medha
    Ghosh, Dipak
    PROCEEDINGS OF 27TH INTERNATIONAL SYMPOSIUM ON FRONTIERS OF RESEARCH IN SPEECH AND MUSIC, FRSM 2023, 2024, 1455 : 239 - 250
  • [7] Music Emotion Recognition by Multi-label Multi-layer Multi-instance Multi-view Learning
    Wu, Bin
    Zhong, Erheng
    Horner, Andrew
    Yang, Qiang
    PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, : 117 - 126
  • [8] Multi-Label Facial Emotion Recognition Using Korean Drama Video Clips
    Cho, Heeryon
    Kang, Woo Kyu
    Park, Youn-Soo
    Chae, Sun Geu
    Kim, Seong-joon
    2022 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (IEEE BIGCOMP 2022), 2022, : 215 - 221
  • [9] Multi-label Learning Approaches for Music Instrument Recognition
    Xioufis, Eleftherios Spyromitros
    Tsoumakas, Grigorios
    Vlahavas, Ioannis
    FOUNDATIONS OF INTELLIGENT SYSTEMS, 2011, 6804 : 734 - 743
  • [10] ONLINE MULTI-LABEL LEARNING WITH ACCELERATED NONSMOOTH STOCHASTIC GRADIENT DESCENT
    Park, Sunho
    Choi, Seungjin
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 3322 - 3326