Genre Classification Empowered by Knowledge-Embedded Music Representation

被引:1
|
作者
Ding, Han [1 ]
Zhai, Linwei [1 ]
Zhao, Cui [1 ]
Wang, Fei [1 ]
Wang, Ge [1 ]
Xi, Wei [1 ]
Wang, Zhi [1 ]
Zhao, Jizhong [1 ]
机构
[1] Xi An Jiao Tong Univ, Fac Elect & Informat Engn, Xian 710049, Peoples R China
基金
国家重点研发计划;
关键词
Instruments; Music; Knowledge graphs; Feature extraction; Correlation; Semantics; Task analysis; Music genre classification; knowledge graph embedding; multi-modality fusion; RETRIEVAL;
D O I
10.1109/TASLP.2024.3402115
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper introduces a pioneering framework for music representation learning, which harnesses knowledge graph embeddings to enrich genre classification. Leveraging metadata from publicly available datasets like FMA and OpenMIC-2018, the constructed knowledge graph delineates intricate relationships among genres, artists, and instruments, offering valuable insights for genre representation. Within this framework, we propose two models tailored for distinct genre classification scenarios: fixed-set genre classification and open-set genre classification. These models exploit the knowledge graph to unveil correlations among different genres and integrate this knowledge into the audio representation. Notably, our approach is the first to merge audio data with high-level knowledge for music genre classification. Experimental results demonstrate that our proposed methods outperform state-of-the-art approaches, achieving an average genre classification accuracy of 68.07% on the FMA-medium dataset and 42.4% for open-set classification on the FMA-large dataset.
引用
收藏
页码:2764 / 2776
页数:13
相关论文
共 50 条
  • [41] Feature Mapping and Fusion for Music Genre Classification
    Balti, Haythem
    Frigui, Hichem
    2012 11TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2012), VOL 1, 2012, : 306 - 310
  • [42] Music Genre Classification Based on Deep Learning
    Zhang, Wenlong
    MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [43] Temporal feature integration for music genre classification
    Meng, Anders
    Ahrendt, Peter
    Larsen, Jan
    Hansen, Lars Kai
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2007, 15 (05): : 1654 - 1664
  • [44] Music Genre Classification: Genre-Specific Characterization and Pairwise Evaluation
    Lefaivre, Adam
    Zhang, John Z.
    2018 CONFERENCE ON INTERACTION WITH SOUND (AUDIO MOSTLY): SOUND IN IMMERSION AND EMOTION (AM'18), 2018,
  • [45] Deep attention based music genre classification
    Yu, Yang
    Luo, Sen
    Liu, Shenglan
    Qiao, Hong
    Liu, Yang
    Feng, Lin
    NEUROCOMPUTING, 2020, 372 : 84 - 91
  • [46] Feature Vector Design for Music Genre Classification
    da Silva Muniz, Victor Hugo
    de Oliveira e Souza Filho, Joao Baptista
    2021 IEEE LATIN AMERICAN CONFERENCE ON COMPUTATIONAL INTELLIGENCE (LA-CCI), 2021,
  • [47] Music Genre Classification with Word and Document Vectors
    Coban, Onder
    Karabey, Isil
    2017 25TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2017,
  • [48] On the Use of Feature Selection for Music Genre Classification
    Al-Tamimi, Abdel-Karim
    Salem, Maher
    Al-Alami, Ahmad
    2020 SEVENTH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY TRENDS (ITT 2020), 2020, : 1 - 6
  • [49] Exploring different approaches for music genre classification
    Homsi Goulart, Antonio Jose
    Guido, Rodrigo Capobianco
    Maciel, Carlos Dias
    EGYPTIAN INFORMATICS JOURNAL, 2012, 13 (02) : 59 - 63
  • [50] A Perceptual Study on Music Segmentation and Genre Classification
    Sanden, Chris
    Befus, Chad R.
    Zhang, John Z.
    JOURNAL OF NEW MUSIC RESEARCH, 2012, 41 (03) : 277 - 293