Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification

被引:142
|
作者
Zhang, Yuxiang [1 ,2 ]
Li, Wei [1 ,2 ]
Zhang, Mengmeng [1 ,2 ]
Wang, Shuai [3 ]
Tao, Ran [1 ,2 ]
Du, Qian [4 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Beijing Key Lab Fract Signals & Syst, Beijing 100081, Peoples R China
[3] Univ Hong Kong, Dept Chem, Hong Kong, Peoples R China
[4] Mississippi State Univ, Dept Elect & Comp Engn, Mississippi State, MS 39762 USA
基金
中国博士后科学基金; 中国国家自然科学基金; 北京市自然科学基金;
关键词
Training; Task analysis; Testing; Feature extraction; Hyperspectral imaging; Power capacitors; Electronic mail; Cross-scene; distribution alignment; domain adaption; few-shot learning (FSL); graph neural network (GNN); hyperspectral image classification; NETWORK;
D O I
10.1109/TNNLS.2022.3185795
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most domain adaptation (DA) methods in cross-scene hyperspectral image classification focus on cases where source data (SD) and target data (TD) with the same classes are obtained by the same sensor. However, the classification performance is significantly reduced when there are new classes in TD. In addition, domain alignment, as one of the main approaches in DA, is carried out based on local spatial information, rarely taking into account nonlocal spatial information (nonlocal relationships) with strong correspondence. A graph information aggregation cross-domain few-shot learning (Gia-CFSL) framework is proposed, intending to make up for the above-mentioned shortcomings by combining FSL with domain alignment based on graph information aggregation. SD with all label samples and TD with a few label samples are implemented for FSL episodic training. Meanwhile, intradomain distribution extraction block (IDE-block) and cross-domain similarity aware block (CSA-block) are designed. The IDE-block is used to characterize and aggregate the intradomain nonlocal relationships and the interdomain feature and distribution similarities are captured in the CSA-block. Furthermore, feature-level and distribution-level cross-domain graph alignments are used to mitigate the impact of domain shift on FSL. Experimental results on three public HSI datasets demonstrate the superiority of the proposed method. The codes will be available from the website: https://github.com/YuxiangZhang-BIT/IEEE_TNNLS_Gia-CFSL.
引用
收藏
页码:1912 / 1925
页数:14
相关论文
共 50 条
  • [1] DUAL GRAPH CROSS-DOMAIN FEW-SHOT LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhang, Yuxiang
    Li, Wei
    Zhang, Mengmeng
    Tao, Ran
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3573 - 3577
  • [2] Deep Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Li, Zhaokui
    Liu, Ming
    Chen, Yushi
    Xu, Yimin
    Li, Wei
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Cross-Domain Few-Shot Learning Based on Graph Convolution Contrast for Hyperspectral Image Classification
    Ye, Zhen
    Wang, Jie
    Sun, Tao
    Zhang, Jinxin
    Li, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [4] Few-Shot Learning With Prototype Rectification for Cross-Domain Hyperspectral Image Classification
    Qin, Anyong
    Yuan, Chaoqi
    Li, Qiang
    Luo, Xiaoliu
    Yang, Feng
    Song, Tiecheng
    Gao, Chenqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] Cross-Domain Few-Shot Graph Classification
    Hassani, Kaveh
    [J]. THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 6856 - 6864
  • [6] Adaptive Domain-Adversarial Few-Shot Learning for Cross-Domain Hyperspectral Image Classification
    Ye, Zhen
    Wang, Jie
    Liu, Huan
    Zhang, Yu
    Li, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Cross-Domain Few-Shot Learning Based on Feature Disentanglement for Hyperspectral Image Classification
    Qin, Boao
    Feng, Shou
    Zhao, Chunhui
    Li, Wei
    Tao, Ran
    Xiang, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [8] Experiments in cross-domain few-shot learning for image classification
    Wang, Hongyu
    Gouk, Henry
    Fraser, Huon
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    [J]. JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2023, 53 (01) : 169 - 191
  • [9] Cross-Domain Few-Shot Contrastive Learning for Hyperspectral Images Classification
    Zhang, Suhua
    Chen, Zhikui
    Wang, Dan
    Wang, Z. Jane
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [10] Spatial-Spectral-Semantic Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Cao, Mengxin
    Zhang, Xu
    Cheng, Jinyong
    Zhao, Guixin
    Li, Wei
    Dong, Xiangjun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62