Artist Similarity Based on Heterogeneous Graph Neural Networks

被引:0
|
作者
da Silva, Angelo Cesar Mendes [1 ]
Silva, Diego Furtado [1 ]
Marcacini, Ricardo Marcondes [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Comp Sci, BR-13566590 Sao Carlos, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Task analysis; Music; Graph neural networks; Data models; Topology; Feature extraction; Speech processing; Artist similarity; artist representation; heterogeneous graph; graph neural networks; musical data representation;
D O I
10.1109/TASLP.2024.3437170
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Music streaming platforms rely on recommending similar artists to maintain user engagement, with artists benefiting from these suggestions to boost their popularity. Another important feature is music information retrieval, allowing users to explore new content. In both scenarios, performance depends on how to compute the similarity between musical content. This is a challenging process since musical data is inherently multimodal, containing textual and audio data. We propose a novel graph-based artist representation that integrates audio, lyrics features, and artist relations. Thus, a multimodal representation on a heterogeneous graph is proposed, along with a network regularization process followed by a GNN model to aggregate multimodal information into a more robust unified representation. The proposed method explores this final multimodal representation for the task of artist similarity as a link prediction problem. Our method introduces a new importance matrix to emphasize related artists in this multimodal space. We compare our approach with other strong baselines based on combining input features, importance matrix construction, and GNN models. Experimental results highlight the superiority of multimodal representation through the transfer learning process and the value of the importance matrix in enhancing GNN models for artist similarity.
引用
收藏
页码:3717 / 3729
页数:13
相关论文
共 50 条
  • [21] Similarity equivariant graph neural networks for homogenization of metamaterials
    Hendriks, Fleur
    Menkovski, Vlado
    Doskar, Martin
    Geers, Marc G. D.
    Rokos, Ondrej
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2025, 439
  • [22] Similarity determination based on data types in heterogeneous databases using neural networks
    Qiang, BH
    Wu, KG
    Liao, XF
    Wu, ZF
    PROCEEDINGS OF 2003 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS & SIGNAL PROCESSING, PROCEEDINGS, VOLS 1 AND 2, 2003, : 377 - 380
  • [23] Fuzzy inputs and missing data in similarity-based heterogeneous neural networks
    Belanche, LA
    Valdés, JJ
    ENGINEERING APPLICATIONS OF BIO-INSPIRED ARTIFICIAL NEURAL NETWORKS, VOL II, 1999, 1607 : 863 - 873
  • [24] GNNkeras: A Keras-based library for Graph Neural Networks and homogeneous and heterogeneous graph processing
    Pancino, Niccolo
    Bongini, Pietro
    Scarselli, Franco
    Bianchini, Monica
    SOFTWAREX, 2022, 18
  • [25] A study on pharmaceutical text relationship extraction based on heterogeneous graph neural networks
    Zou, Shuilong
    Liu, Zhaoyang
    Wang, Kaiqi
    Cao, Jun
    Liu, Shixiong
    Xiong, Wangping
    Li, Shaoyi
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2024, 21 (01) : 1489 - 1507
  • [26] RHGNN: Fake reviewer detection based on reinforced heterogeneous graph neural networks
    Zhao, Jun
    Shao, Minglai
    Tang, Hailiang
    Liu, Jianchao
    Du, Lin
    Wang, Hong
    KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [27] Meta-path-based heterogeneous graph neural networks in academic network
    Xingxing Liang
    Yang Ma
    Guangquan Cheng
    Changjun Fan
    Yuling Yang
    Zhong Liu
    International Journal of Machine Learning and Cybernetics, 2022, 13 : 1553 - 1569
  • [28] Heterogeneous Global Graph Neural Networks for Personalized Session-based Recommendation
    Pang, Yitong
    Wu, Lingfei
    Shen, Qi
    Zhang, Yiming
    Wei, Zhihua
    Xu, Fangli
    Chang, Ethan
    Long, Bo
    Pei, Jian
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 775 - 783
  • [29] Meta-path-based heterogeneous graph neural networks in academic network
    Liang, Xingxing
    Ma, Yang
    Cheng, Guangquan
    Fan, Changjun
    Yang, Yuling
    Liu, Zhong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (06) : 1553 - 1569
  • [30] MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networks
    Fu, Xinyu
    King, Irwin
    NEURAL NETWORKS, 2024, 170 : 266 - 275