Multiple Embeddings Contrastive Pretraining for Remote Sensing Image Classification

被引:0
|
作者
Xu, Yin [1 ]
Guo, Weiwei [2 ]
Zhang, Zenghui [1 ]
Yu, Wenxian [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[2] Tongji Univ, Ctr Digital Innovat, Shanghai 200092, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Task analysis; Visualization; Feature extraction; Image classification; Training; Optical sensors; Contrastive learning; image representation learning; remote sensing image; self-supervised learning (SSL);
D O I
10.1109/LGRS.2022.3185729
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
This letter focuses on remote sensing image interpretation and aims to promote the use of contrastive self-supervised learning (SSL) in varied applications of remote sensing image classification. The proposed method is a contrastive self-supervised pretraining framework that encourages the network to learn image representations by comparing image embeddings extracted by different encoders and predictors. Experiments were carried out on a variety of remote sensing image datasets to determine the efficacy of the proposed method for classification tasks. Results show that the proposed framework exploits the capabilities of encoders and outperforms the supervised learning method in terms of classification accuracy. Besides, it takes a few pretraining epochs to find a suboptimal initialization of network weights, and the pretrained encoders use a little training data to get outstanding classification results, which shows the time and data efficiency of the proposed framework. Code is available at https://github.com/yinxu98/MECo.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Multiple Embeddings Contrastive Pretraining for Remote Sensing Image Classification
    Xu, Yin
    Guo, Weiwei
    Zhang, Zenghui
    Yu, Wenxian
    [J]. IEEE Geoscience and Remote Sensing Letters, 2022, 19
  • [2] THE EFFECT OF CONTRASTIVE PRETRAINING ON DOWNSTREAM TASKS IN OPTICAL REMOTE SENSING
    Prexl, Jonathan
    Schmitt, Michael
    [J]. IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, : 526 - 529
  • [3] Vision Transformer With Contrastive Learning for Remote Sensing Image Scene Classification
    Bi, Meiqiao
    Wang, Minghua
    Li, Zhi
    Hong, Danfeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 738 - 749
  • [4] Remote Sensing Image Scene Classification Based on Supervised Contrastive Learning
    Guo Dongen
    Xia Ying
    Luo Xiaobo
    Feng Jiangfan
    [J]. ACTA PHOTONICA SINICA, 2021, 50 (07)
  • [5] Cross-Modal Contrastive Learning for Remote Sensing Image Classification
    Feng, Zhixi
    Song, Liangliang
    Yang, Shuyuan
    Zhang, Xinyu
    Jiao, Licheng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] EMSCNet: Efficient Multisample Contrastive Network for Remote Sensing Image Scene Classification
    Zhao, Yibo
    Liu, Jianjun
    Yang, Jinlong
    Wu, Zebin
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Remote sensing image feature extraction and classification based on contrastive learning method
    Mu X.-D.
    Bai K.
    You X.-A.
    Zhu Y.-Q.
    Chen X.-B.
    [J]. Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2021, 29 (09): : 2222 - 2234
  • [8] Multiple Kernel Learning for Remote Sensing Image Classification
    Niazmardi, Saeid
    Demir, Begum
    Bruzzone, Lorenzo
    Safari, Abdolreza
    Homayouni, Saeid
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (03): : 1425 - 1443
  • [9] Multispectral remote sensing image classification with multiple features
    Yin, Qian
    Guo, Ping
    [J]. PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 360 - +
  • [10] Dual Contrastive Network for Few-Shot Remote Sensing Image Scene Classification
    Ji, Zhong
    Hou, Liyuan
    Wang, Xuan
    Wang, Gang
    Pang, Yanwei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61