Multi-label emotion recognition from Indian classical music using gradient descent SNN model

被引:6
|
作者
Tiple, Bhavana [1 ]
Patwardhan, Manasi [2 ]
机构
[1] Dr Vishwanath Karad MIT World Peace Univ, Sch SCET, Pune, Maharashtra, India
[2] TCS Innovat Labs, Pune, Maharashtra, India
关键词
Convolutional neural network; Spiking neural network; Gradient descent; Temporal; Spectral; Short Term Fourier Transform; SPIKING NEURAL-NETWORK; CLASSIFICATION;
D O I
10.1007/s11042-022-11975-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Music enthusiasts are growing exponentially and based on this, many songs are being introduced to the market and stored in signal music libraries. Due to this development emotion recognition model from music contents has received increasing attention in today's world. Of these technologies, a novel Music Emotion Recognition (MER) system is introduced to meet the ever-increasing demand for easy and efficient access to music information. Even though this system was well-developed it lacks in maintaining accuracy of the system and finds difficulty in predicting multi-label emotion type. To address these shortcomings, in this research article, a novel MER system is developed by inter-linking the pre-processing, feature extraction and classification steps. Initially, pre-processing step is employed to convert larger audio files into smaller audio frames. Afterwards, music related temporal, spectral and energy features are extracted for those pre-processed frames which are subjected to the proposed gradient descent based Spiking Neural Network (SNN) classifier. While learning SNN, it is important to determine the optimal weight values for reducing the training error so that gradient descent optimization approach is adopted. To prove the effectiveness of proposed research, proposed model is compared with conventional classification algorithms. The proposed methodology was experimentally tested using various evaluation metrics and it achieves 94.55% accuracy. Hence the proposed methodology attains a good accuracy measure and outperforms well than other algorithms.
引用
收藏
页码:8853 / 8870
页数:18
相关论文
共 50 条
  • [31] Multi-Task Music Representation Learning from Multi-Label Embeddings
    Schindler, Alexander
    Knees, Peter
    2019 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2019,
  • [32] What Strikes the Strings of Your Heart? - Multi-Label Dimensionality Reduction for Music Emotion Analysis
    Liu, Yang
    Liu, Yan
    Zhao, Yu
    Hua, Kien A.
    PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, : 1069 - 1072
  • [33] Multi-Label Emotion Classification of Online Learners' Reviews Using Machine Learning Text-Based Multi-Label Classification Approach
    Makhoukhi, Hajar
    Roubi, Sarra
    2024 5TH INTERNATIONAL CONFERENCE ON EDUCATION DEVELOPMENT AND STUDIES, ICEDS 2024, 2024, : 59 - 64
  • [34] Multi-Label Multimodal Emotion Recognition With Transformer-Based Fusion and Emotion-Level Representation Learning
    Le, Hoai-Duy
    Lee, Guee-Sang
    Kim, Soo-Hyung
    Kim, Seungwon
    Yang, Hyung-Jeong
    IEEE ACCESS, 2023, 11 : 14742 - 14751
  • [35] Seq2Emo: A Sequence to Multi-Label Emotion Classification Model
    Huang, Chenyang
    Trabelsi, Amine
    Qin, Xuebin
    Farruque, Nawshad
    Mou, Lili
    Zaiane, Osmar
    2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), 2021, : 4717 - 4724
  • [36] A Fusion Model for Multi-label Emotion Classification Based on BERT and Topic Clustering
    Ding, Fei
    Kang, Xin
    Nishide, Shun
    Guan, Zhijin
    Ren, Fuji
    INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2020, 2020, 11574
  • [37] A Corpus-based Multi-label Emotion Classification using Maximum Entropy
    Wu, Ye
    Ren, Fuji
    NATURAL LANGUAGE PROCESSING AND COGNITIVE SCIENCE, PROCEEDINGS, 2009, : 103 - 110
  • [38] Multi-label Emotion Classification using Content-Based Features in Twitter
    Ameer, Iqra
    Ashraf, Noman
    Sidorov, Grigori
    Gomez-Adorno, Helena
    COMPUTACION Y SISTEMAS, 2020, 24 (03): : 1159 - 1164
  • [39] CONTEXT-AWARE GENERATION-BASED NET FOR MULTI-LABEL VISUAL EMOTION RECOGNITION
    Ruan, Shulan
    Zhang, Kun
    Wang, Yijun
    Tao, Hanqing
    He, Weidong
    Lv, Guangyi
    Chen, Enhong
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [40] Disorder recognition in clinical texts using multi-label structured SVM
    Wutao Lin
    Donghong Ji
    Yanan Lu
    BMC Bioinformatics, 18