Spatial-Spectral-Semantic Cross-Domain Few-Shot Learning for Hyperspectral Image Classification

被引:0
|
作者
Cao, Mengxin [1 ,2 ]
Zhang, Xu [1 ,2 ]
Cheng, Jinyong [1 ,2 ]
Zhao, Guixin [1 ,2 ]
Li, Wei [3 ]
Dong, Xiangjun [1 ,2 ]
机构
[1] Qilu Univ Technol, Shandong Acad Sci, Shandong Comp Sci Ctr, Key Lab Comp Power Network & Informat Secur,Minist, Jinan 250316, Peoples R China
[2] Shandong Fundamental Res Ctr Comp Sci, Shandong Prov Key Lab Comp Networks, Jinan 250014, Peoples R China
[3] Beijing Inst Technol, Sch Informat & Elect, Beijing 100081, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-domain; distribution alignment; domain adaption; few-shot learning (FSL); hyperspectral image (HSI) classification; ADAPTATION; FUSION;
D O I
10.1109/TGRS.2024.3434484
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Preprocessing procedures are commonly employed to reduce water-absorption bands and noise in hyperspectral images (HSIs). Nevertheless, they typically do not entirely eradicate noise. This is especially evident in scenarios that necessitate data of exceptional quality, such as cross-domain few-shot classification tasks. Within these specific conditions, the influence of remaining background noise on the ultimate results of classification is substantial. Furthermore, the presence of sample selection biases in the few-shot task might lead to the emergence of false statistical correlations between data from distinct domains, resulting in a decrease in the model's ability to generalize. We propose a new method called spatial-spectral-semantic cross-domain few-shot learning ((SCFSL)-C-3) to address the challenge. This method promotes the learning of transferable information by incorporating feature denoising operations in the feature extraction process to restore essential information. Concurrently, it enhances cross-domain distributional consistency by introducing a semantic-aware strategy to strengthen the association between cross-domain data and semantic information. Specifically, the spatial and spectral dual channels (SSDCs), in conjunction with the cross-spatial-spectral transformer (CSST), are designed as a feature extractor to acquire interactive spatial-spectral features. The feature-denoising operations can further acquiring transferable information from cross-domain features, thus facilitating meta-learning in both the source domain (SD) and the target domain (TD). Meanwhile, a semantic-enhanced domain alignment (SEDA) is designed to promote domain adaptation by using a semantic-aware strategy, which significantly enhances distributional consistency for cross-domain tasks. Our results exhibit exceptional classification efficacy in comparison to other state-of-the-art approaches on three public HSI datasets.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] FEW-SHOT HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON CROSS-DOMAIN SPECTRAL SEMANTIC RELATION TRANSFORMER
    Cao, Mengxin
    Zhao, Guixin
    Dong, Aimei
    Lv, Guohua
    Guo, Ying
    Dong, Xiangjun
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1375 - 1379
  • [2] Deep Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Li, Zhaokui
    Liu, Ming
    Chen, Yushi
    Xu, Yimin
    Li, Wei
    Du, Qian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] DUAL GRAPH CROSS-DOMAIN FEW-SHOT LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Zhang, Yuxiang
    Li, Wei
    Zhang, Mengmeng
    Tao, Ran
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3573 - 3577
  • [4] Few-Shot Learning With Prototype Rectification for Cross-Domain Hyperspectral Image Classification
    Qin, Anyong
    Yuan, Chaoqi
    Li, Qiang
    Luo, Xiaoliu
    Yang, Feng
    Song, Tiecheng
    Gao, Chenqiang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [5] SCFormer: Spectral Coordinate Transformer for Cross-Domain Few-Shot Hyperspectral Image Classification
    Li, Jiaojiao
    Zhang, Zhiyuan
    Song, Rui
    Li, Yunsong
    Du, Qian
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 840 - 855
  • [6] Adaptive Domain-Adversarial Few-Shot Learning for Cross-Domain Hyperspectral Image Classification
    Ye, Zhen
    Wang, Jie
    Liu, Huan
    Zhang, Yu
    Li, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Graph Information Aggregation Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Zhang, Yuxiang
    Li, Wei
    Zhang, Mengmeng
    Wang, Shuai
    Tao, Ran
    Du, Qian
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 1912 - 1925
  • [8] Cross-Domain Few-Shot Learning Based on Feature Disentanglement for Hyperspectral Image Classification
    Qin, Boao
    Feng, Shou
    Zhao, Chunhui
    Li, Wei
    Tao, Ran
    Xiang, Wei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [9] Experiments in cross-domain few-shot learning for image classification
    Wang, Hongyu
    Gouk, Henry
    Fraser, Huon
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    [J]. JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2023, 53 (01) : 169 - 191
  • [10] Cross-Domain Few-Shot Contrastive Learning for Hyperspectral Images Classification
    Zhang, Suhua
    Chen, Zhikui
    Wang, Dan
    Wang, Z. Jane
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19