Contrastive Learning Based on Transformer for Hyperspectral Image Classification

被引:35
|
作者
Hu, Xiang [1 ]
Li, Teng [2 ,3 ]
Zhou, Tong [1 ,2 ]
Liu, Yu [3 ]
Peng, Yuanxi [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, State Key Lab High Performance Comp, Changsha 410073, Peoples R China
[2] Natl Univ Def Technol, Beijing Inst Adv Study, Beijing 100020, Peoples R China
[3] Natl Univ Def Technol, Coll Adv Interdisciplinary Studies, Changsha 410073, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 18期
基金
中国国家自然科学基金;
关键词
deep learning; transformer; unsupervised hyperspectral image classification; contrastive learning;
D O I
10.3390/app11188670
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Recently, deep learning has achieved breakthroughs in hyperspectral image (HSI) classification. Deep-learning-based classifiers require a large number of labeled samples for training to provide excellent performance. However, the availability of labeled data is limited due to the significant human resources and time costs of labeling hyperspectral data. Unsupervised learning for hyperspectral image classification has thus received increasing attention. In this paper, we propose a novel unsupervised framework based on a contrastive learning method and a transformer model for hyperspectral image classification. The experimental results prove that our model can efficiently extract hyperspectral image features in unsupervised situations.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Vision Transformer With Contrastive Learning for Hyperspectral Image Classification
    Zhou, Heng
    Zhang, Xin
    Zhang, Chunlei
    Ma, Qiaoyu
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [2] ConVaT: A Variational Generative Transformer With Momentum Contrastive Learning for Hyperspectral Image Classification
    Liang, Miaomiao
    Liu, Zuo
    Dong, Jian
    Yu, Lingjuan
    Yu, Xiangchun
    Li, Jun
    Jiao, Licheng
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [3] Classification Based on Hyperspectral Image and LiDAR Data with Contrastive Learning
    Li Shihan
    Hua Haiyang
    Zhang Hao
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (22)
  • [4] Supervised Contrastive Learning-Based Classification for Hyperspectral Image
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    Ghamisi, Pedram
    [J]. REMOTE SENSING, 2022, 14 (21)
  • [5] Transformer-Based Masked Autoencoder With Contrastive Loss for Hyperspectral Image Classification
    Cao, Xianghai
    Lin, Haifeng
    Guo, Shuaixu
    Xiong, Tao
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] Spectral-Spatial Masked Transformer With Supervised and Contrastive Learning for Hyperspectral Image Classification
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] A 3-D-Swin Transformer-Based Hierarchical Contrastive Learning Method for Hyperspectral Image Classification
    Huang, Xin
    Dong, Mengjie
    Li, Jiayi
    Guo, Xian
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Transformer-based unsupervised contrastive learning for histopathological image classification
    Wang, Xiyue
    Yang, Sen
    Zhang, Jun
    Wang, Minghui
    Zhang, Jing
    Yang, Wei
    Huang, Junzhou
    Han, Xiao
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 81
  • [9] Hyperspectral Imagery Classification Based on Contrastive Learning
    Hou, Sikang
    Shi, Hongye
    Cao, Xianghai
    Zhang, Xiaohua
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Progressive Contrastive Learning Based on Noisy Negatives Cleaning for Hyperspectral Image Classification
    Zhao, Lin
    Feng, Yang
    Dai, YuanJie
    Wu, Jianhui
    Zhang, Guoyun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5