Label-aware aggregation on heterophilous graphs for node representation learning

被引:0
|
作者
Liu, Linruo [1 ]
Wang, Yangtao [1 ]
Xie, Yanzhao [1 ]
Tan, Xin [2 ]
Ma, Lizhuang [3 ]
Tang, Maobin [1 ]
Fang, Meie [1 ]
机构
[1] Guangzhou Univ, Sch Comp Sci & Cyber Engn, Guangzhou 510006, Peoples R China
[2] East China Normal Univ, Shanghai 200062, Peoples R China
[3] Shanghai Jiao Tong Univ, Shanghai 200240, Peoples R China
关键词
Heterophilous graphs; Label-aware aggregation; Node representation learning;
D O I
10.1016/j.displa.2024.102817
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Learning node representation on heterophilous graphs has been challenging due to nodes with diverse labels/attributes being connected. The main idea is to balance contributions between the center node and neighborhoods. However, existing methods failed to make full use of personalized contributions of different neighborhoods based on whether they own the same label as the center node, making it necessary to explore the distinctive contributions of similar/dissimilar neighborhoods. We reveal that both similar/dissimilar neighborhoods have positive impacts on feature aggregation under different homophily ratios. Especially, dissimilar neighborhoods play a significant role under low homophily ratios. Based on this, we propose LAAH, a label-aware aggregation approach for node representation learning on heterophilous graphs. LAAH separates each center node from its neighborhoods and generates their own node representations. Additionally, for each neighborhood, LAAH records its label information based on whether it belongs to the same class as the center node and then aggregates its effective feature in a weighted manner. Finally, a learnable parameter is used to balance the contributions of each center node and all its neighborhoods, leading to updated representations. Extensive experiments on 8 real-world heterophilous datasets and a synthetic dataset verify that LAAH can achieve competitive or superior accuracy in node classification with lower parameter scale and computational complexity compared with the SOTA methods. The code is released at GitHub: https://github.com/laah123graph/LAAH.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Label-Aware Aggregation for Improved Federated Learning
    Khalil, Ahmad
    Wainakh, Aidmar
    Zimmer, Ephraim
    Parra-Arnau, Javier
    Fernandez Anta, Antonio
    Meuser, Tobias
    Steinmetz, Ralf
    [J]. 2023 EIGHTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING, FMEC, 2023, : 216 - 223
  • [2] Label-aware graph representation learning for multi-label image classification
    Chen, Yilu
    Zou, Changzhong
    Chen, Jianli
    [J]. NEUROCOMPUTING, 2022, 492 : 50 - 61
  • [3] Candidate Label-Aware Partial Label Learning Algorithm
    Chen Hongchang
    Xie Tian
    Gao Chao
    Li Shaomei
    Huang Ruiyang
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2019, 41 (10) : 2516 - 2524
  • [4] LABEL-AWARE TEXT REPRESENTATION FOR MULTI-LABEL TEXT CLASSIFICATION
    Guo, Hao
    Li, Xiangyang
    Zhang, Lei
    Liu, Jia
    Chen, Wei
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7728 - 7732
  • [5] GCNH: A Simple Method For Representation Learning On Heterophilous Graphs
    Cavallo, Andrea
    Grohnfeldt, Claas
    Russo, Michele
    Lovisotto, Giulio
    Vassio, Luca
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [6] Label-Aware Graph Convolutional Networks
    Chen, Hao
    Xu, Yue
    Huang, Feiran
    Deng, Zengde
    Huang, Wenbing
    Wang, Senzhang
    He, Peng
    Li, Zhoujun
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 1977 - 1980
  • [7] Label-Aware Global Consistency for Multi-Label Learning with Single Positive Labels
    Xie, Ming-Kun
    Xiao, Jia-Hao
    Huang, Sheng-Jun
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [8] Label-Aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification
    Xin Huang
    Boli Chen
    Lin Xiao
    Jian Yu
    Liping Jing
    [J]. Neural Processing Letters, 2022, 54 : 3601 - 3617
  • [9] Label-Aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification
    Huang, Xin
    Chen, Boli
    Xiao, Lin
    Yu, Jian
    Jing, Liping
    [J]. NEURAL PROCESSING LETTERS, 2022, 54 (05) : 3601 - 3617
  • [10] Text multi-label learning method based on label-aware attention and semantic dependency
    Liu, Baisong
    Liu, Xiaoling
    Ren, Hao
    Qian, Jiangbo
    Wang, YangYang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 7219 - 7237