Genre Classification Empowered by Knowledge-Embedded Music Representation

被引:1
|
作者
Ding, Han [1 ]
Zhai, Linwei [1 ]
Zhao, Cui [1 ]
Wang, Fei [1 ]
Wang, Ge [1 ]
Xi, Wei [1 ]
Wang, Zhi [1 ]
Zhao, Jizhong [1 ]
机构
[1] Xi An Jiao Tong Univ, Fac Elect & Informat Engn, Xian 710049, Peoples R China
基金
国家重点研发计划;
关键词
Instruments; Music; Knowledge graphs; Feature extraction; Correlation; Semantics; Task analysis; Music genre classification; knowledge graph embedding; multi-modality fusion; RETRIEVAL;
D O I
10.1109/TASLP.2024.3402115
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper introduces a pioneering framework for music representation learning, which harnesses knowledge graph embeddings to enrich genre classification. Leveraging metadata from publicly available datasets like FMA and OpenMIC-2018, the constructed knowledge graph delineates intricate relationships among genres, artists, and instruments, offering valuable insights for genre representation. Within this framework, we propose two models tailored for distinct genre classification scenarios: fixed-set genre classification and open-set genre classification. These models exploit the knowledge graph to unveil correlations among different genres and integrate this knowledge into the audio representation. Notably, our approach is the first to merge audio data with high-level knowledge for music genre classification. Experimental results demonstrate that our proposed methods outperform state-of-the-art approaches, achieving an average genre classification accuracy of 68.07% on the FMA-medium dataset and 42.4% for open-set classification on the FMA-large dataset.
引用
收藏
页码:2764 / 2776
页数:13
相关论文
共 50 条
  • [31] Genre classification of symbolic pieces of music
    Marcelo G. Armentano
    Walter A. De Noni
    Hernán F. Cardoso
    Journal of Intelligent Information Systems, 2017, 48 : 579 - 599
  • [32] Boosting classifiers for music genre classification
    Bagci, Ulas
    Erzin, Engin
    2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, 2006, : 214 - +
  • [33] Inter genre similarity modeling for automatic music genre classification
    Bagci, Ulas
    Erzin, Engin
    2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, 2006, : 639 - +
  • [34] Survey on Features and Classification Techniques in Music Genre Classification
    Patil, Swati A.
    Rao, K. Thirupathi
    Patil, Sonal
    HELIX, 2018, 8 (05): : 3833 - 3837
  • [35] Music Genre Classification via Joint Sparse Low-Rank Representation of Audio Features
    Panagakis, Yannis
    Kotropoulos, Constantine L.
    Arce, Gonzalo R.
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (12) : 1905 - 1917
  • [36] A development of knowledge-embedded, modularized simulation modeling system for heavy construction operations
    Kyong Ju Kim
    G. Edward Gibson
    KSCE Journal of Civil Engineering, 1999, 3 (3) : 251 - 260
  • [37] Brain and Music: Music Genre Classification using Brain Signals
    Ghaemmaghami, Pouya
    Sebe, Nicu
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 708 - 712
  • [38] Music genre classification and music recommendation by using deep learning
    Elbir, A.
    Aydin, N.
    ELECTRONICS LETTERS, 2020, 56 (12) : 627 - 629
  • [39] Knowledge-embedded meta-learning model for lift coefficient prediction of airfoils
    Xie, Hairun
    Wang, Jing
    Zhang, Miao
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 233
  • [40] A Study on Broadcast Networks for Music Genre Classification
    Heakl, Ahmed
    Abdelgawad, Abdelrahman
    Parque, Victor
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,