Task context transformer and GCN for few-shot learning of cross-domain

被引:1
|
作者
Li, Pengfang [1 ,2 ,3 ,4 ]
Liu, Fang [1 ,2 ,3 ,4 ]
Jiao, Licheng [1 ,2 ,3 ,4 ]
Li, Lingling [1 ,2 ,3 ,4 ]
Chen, Puhua [1 ,2 ,3 ,4 ]
Li, Shuo [1 ,2 ,3 ,4 ]
机构
[1] Minist Educ, Key Lab Intelligent Percept & Image Understanding, Xian, Peoples R China
[2] Int Res Ctr Intelligent Percept & Computat, Beijing, Peoples R China
[3] Joint Int Res Lab Intelligent Percept & Computat, Xian, Peoples R China
[4] Xidian Univ, Sch Artificial Intelligent, 2 Taibai South Rd, Xian 710071, Shaanxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-domain; Few-shot learning; Feature fusion; Task context modeling; Adaptive feature learning; NETWORK;
D O I
10.1016/j.neucom.2023.126433
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cross-Domain Few-Shot Learning (CD-FSL) to recognize new categories in a new domain with few samples has attracted significant attention. Recently, task-specific CD-FSL emerges as promising research for its great generalization. However, the existing task-specific CD-FSL methods are not robust enough in task context modeling and task-specific feature learning, especially under the cross-domain setting. To tackle this problem, a Task Context Transformer and Graph Convolutional Network (TCT-GCN) method for CD-FSL is proposed. The proposed TCT-GCN constructs three modules: 1) Multi-Level Feature Fusion, which fuses domain-shared low-level features into domain-unshared high-level features; 2) Transformer-based Task Context Encoder, which models sample order-independent task context; 3) Graph Convolutional Network-based Adaptive Feature Learner, which adaptively learns task-specific features. Experiments on eight CD-FSL datasets reveal the effectiveness of our TCT-GCN. & COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Task-Adaptive Prompted Transformer for Cross-Domain Few-Shot Learning
    Wu, Jiamin
    Liu, Xin
    Yin, Xiaotian
    Zhang, Tianzhu
    Zhang, Yongdong
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 6012 - 6020
  • [2] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 288
  • [3] Cross-domain few-shot learning via adaptive transformer networks
    Paeedeh, Naeem
    Pratama, Mahardhika
    Ma'sum, Muhammad Anwar
    Mayer, Wolfgang
    Cao, Zehong
    Kowlczyk, Ryszard
    [J]. Knowledge-Based Systems, 2024, 288
  • [4] Cross-domain Few-shot Learning with Task-specific Adapters
    Li, Wei-Hong
    Liu, Xialei
    Bilen, Hakan
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7151 - 7160
  • [5] Task-aware Adaptive Learning for Cross-domain Few-shot Learning
    Guo, Yurong
    Du, Ruoyi
    Dong, Yuan
    Hospedales, Timothy
    Song, Yi-Zhe
    Ma, Zhanyu
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1590 - 1599
  • [6] Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty
    Oh, Jaehoon
    Kim, Sungnyun
    Ho, Namgyu
    Kim, Jin-Hwa
    Song, Hwanjun
    Yun, Se-Young
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [7] Knowledge transduction for cross-domain few-shot learning
    Li, Pengfang
    Liu, Fang
    Jiao, Licheng
    Li, Shuo
    Li, Lingling
    Liu, Xu
    Huang, Xinyan
    [J]. PATTERN RECOGNITION, 2023, 141
  • [8] Task-Level Self-Supervision for Cross-Domain Few-Shot Learning
    Yuan, Wang
    Zhang, Zhizhong
    Wang, Cong
    Song, Haichuan
    Xie, Yuan
    Ma, Lizhuang
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3215 - 3223
  • [9] Task-Aware Adversarial Feature Perturbation for Cross-Domain Few-Shot Learning
    Ma, Yixiao
    Li, Fanzhang
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 566 - 578
  • [10] Feature extractor stacking for cross-domain few-shot learning
    Wang, Hongyu
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    [J]. MACHINE LEARNING, 2024, 113 (01) : 121 - 158