Few-shot Heterogeneous Graph Learning via Cross-domain Knowledge Transfer

被引:5
|
作者
Zhang, Qiannan [1 ]
Wu, Xiaodong [1 ]
Yang, Qiang [1 ]
Zhang, Chuxu [2 ]
Zhang, Xiangliang [1 ,3 ]
机构
[1] King Abdullah Univ Sci & Technol, Thuwal, Saudi Arabia
[2] Brandeis Univ, Waltham, MA 02254 USA
[3] Univ Notre Dame, Notre Dame, IN 46556 USA
关键词
Heterogeneous Graphs; Few-shot Learning; Knowledge Transfer;
D O I
10.1145/3534678.3539431
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph few-shot learning seeks to alleviate the label scarcity problem resulting from the difficulties and high cost of data annotations in graph learning. However, the overwhelming solutions in graph few-shot learning focus on homogeneous graphs, ignoring the ubiquitous heterogeneous graphs (HGs), which represent real-world complex systems and domain knowledge with multi-typed nodes interconnected by multi-typed edges. To this end, we study the crossdomain few-shot learning problem over HGs and develop a novel model for Cross-domain Heterogeneous Graph Meta-learning (CrossHG-Meta). The general idea is to promote the HG node classification in the data-scarce target domain by transferring metaknowledge from a series of HGs in data-rich source domains. The key challenges are to 1) combat the heterogeneity in HGs to acquire the transferable meta-knowledge; 2) handle the domain shifts between the source HG and target HG; and 3) fast adapt to novel target tasks with few-shot annotated examples. Regarding the graph heterogeneity, CrossHG-Meta firstly builds a graph encoder to aggregate heterogeneous neighborhood information from multiple semantic contexts. Secondly, to tackle domain shifts, a cross-domain meta-learning strategy is proposed to include a domain critic, which is designed to explicitly lead cross-domain adaptation for metatasks in different domains and improve model generalizability. Last, to further alleviate data scarcity, CrossHG-Meta leverages unlabeled information in source domains with auxiliary self-supervised learning task to provide cross-domain contrastive regularization alongside the meta-optimization process to facilitate node embedding. Extensive experimental results on three multi-domain HG datasets demonstrate that the proposed model outperforms various state-of-the-art baselines for multiple few-shot node classification tasks under the cross-domain setting.
引用
收藏
页码:2450 / 2460
页数:11
相关论文
共 50 条
  • [31] Dual Adaptive Representation Alignment for Cross-Domain Few-Shot Learning
    Zhao Y.
    Zhang T.
    Li J.
    Tian Y.
    [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45 (10) : 11720 - 11732
  • [32] Cross-Domain Few-Shot Contrastive Learning for Hyperspectral Images Classification
    Zhang, Suhua
    Chen, Zhikui
    Wang, Dan
    Wang, Z. Jane
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [33] Cross-domain few-shot learning based on feature adaptive distillation
    Dingwei Zhang
    Hui Yan
    Yadang Chen
    Dichao Li
    Chuanyan Hao
    [J]. Neural Computing and Applications, 2024, 36 : 4451 - 4465
  • [34] Learning general features to bridge the cross-domain gaps in few-shot
    Li, Xiang
    Luo, Hui
    Zhou, Gaofan
    Peng, Xiaoming
    Wang, Zhixing
    Zhang, Jianlin
    Liu, Dongxu
    Li, Meihui
    Liu, Yungfeng
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [35] Teachers cooperation:team-knowledge distillation for multiple cross-domain few-shot learning
    Zhong JI
    Jingwei NI
    Xiyao LIU
    Yanwei PANG
    [J]. Frontiers of Computer Science, 2023, 17 (02) : 95 - 103
  • [36] Target Oriented Dynamic Adaption for Cross-Domain Few-Shot Learning
    Chang, Xinyi
    Du, Chunyu
    Song, Xinjing
    Liu, Weifeng
    Wang, Yanjiang
    [J]. NEURAL PROCESSING LETTERS, 2024, 56 (03)
  • [37] Task context transformer and GCN for few-shot learning of cross-domain
    Li, Pengfang
    Liu, Fang
    Jiao, Licheng
    Li, Lingling
    Chen, Puhua
    Li, Shuo
    [J]. NEUROCOMPUTING, 2023, 548
  • [38] CDFSL-V: Cross-Domain Few-Shot Learning for Videos
    Samarasinghe, Sarinda
    Rizve, Mamshad Nayeem
    Kardan, Navid
    Shah, Mubarak
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11609 - 11618
  • [39] Teachers cooperation: team-knowledge distillation for multiple cross-domain few-shot learning
    Zhong Ji
    Jingwei Ni
    Xiyao Liu
    Yanwei Pang
    [J]. Frontiers of Computer Science, 2023, 17
  • [40] Task-aware Adaptive Learning for Cross-domain Few-shot Learning
    Guo, Yurong
    Du, Ruoyi
    Dong, Yuan
    Hospedales, Timothy
    Song, Yi-Zhe
    Ma, Zhanyu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1590 - 1599