Self-Supervised GlobalLocal Contrastive Learning for Fine-Grained Change Detection in VHR Images

被引:15
|
作者
Jiang, Fenlong [1 ]
Gong, Maoguo [1 ]
Zheng, Hanhong [1 ]
Liu, Tongfei [1 ]
Zhang, Mingyang [1 ]
Liu, Jialu [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection (CD); contrastive learning (CL); global-local framework; self-supervised learning; very high resolution (VHR) images; CLASSIFICATION; ATTENTION; NETWORKS;
D O I
10.1109/TGRS.2023.3238327
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Self-supervised contrastive learning (CL) can learn high-quality feature representations that are beneficial to downstream tasks without labeled data. However, most CL methods are for image-level tasks. For the fine-grained change detection (FCD) tasks, such as change or change trend detection of some specific ground objects, it is usually necessary to perform pixel-level discriminative analysis. Therefore, feature representations learned by image-level CL may have limited effects on FCD. To address this problem, we propose a self-supervised global-local contrastive learning (GLCL) framework, which extends the instance discrimination task to the pixel level. GLCL follows the current mainstream CL paradigm and consists of four parts, including data augmentation to generate different views of the input, an encoder network for feature extraction, a global CL head, and a local CL head to perform image-level and pixel-level instance discrimination tasks, respectively. Through GLCL, features belonging to different perspectives of the same instance will be pulled closer, while features of different instances will be alienated, which can enhance the discriminativeness of feature representations from both global and local perspectives, thereby facilitating downstream FCD tasks. In addition, GLCL makes a targeted structural adaptation to FCD, i.e., the encoder network is undertaken by the common backbone networks of FCD, which can accelerate the deployment on downstream FCD tasks. Experimental results on several real datasets show that compared with other parameter initialization methods, the FCD models pretrained by GLCL can obtain better detection performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Siamese self-supervised learning for fine-grained visual classification
    Ji, Ruyi
    Li, Jiaying
    Zhang, Libo
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 229
  • [2] Self-supervised contrastive learning on agricultural images
    Guldenring, Ronja
    Nalpantidis, Lazaros
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 191
  • [3] Fine-Grained Self-Supervised Learning with Jigsaw puzzles for medical image classification
    Department of Software, Ajou University, Korea, Republic of
    不详
    [J]. Comput. Biol. Med., 2024,
  • [4] A robust self-supervised approach for fine-grained crack detection in concrete structures
    Sohaib, Muhammad
    Hasan, Md Junayed
    Shah, Mohd Asif
    Zheng, Zhonglong
    [J]. SCIENTIFIC REPORTS, 2024, 14 (01):
  • [5] Multicue Contrastive Self-Supervised Learning for Change Detection in Remote Sensing
    Yang, Meijuan
    Jiao, Licheng
    Liu, Fang
    Hou, Biao
    Yang, Shuyuan
    Zhang, Yake
    Wang, Jianlong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 14
  • [6] Contrastive Representations for Continual Learning of Fine-Grained Histology Images
    Chakraborti, Tapabrata
    Gleeson, Fergus
    Rittscher, Jens
    [J]. MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2021, 2021, 12966 : 1 - 9
  • [7] Self-Supervised Antipodal Grasp Learning With Fine-Grained Grasp Quality Feedback in Clutter
    Hou, Yanxu
    Li, Jun
    Chen, I-Ming
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2024, 71 (04) : 3853 - 3861
  • [8] Coreset Sampling from Open-Set for Fine-Grained Self-Supervised Learning
    Kim, Sungnyun
    Bae, Sangmin
    Yun, Young
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 7537 - 7547
  • [9] PCLDet: Prototypical Contrastive Learning for Fine-Grained Object Detection in Remote Sensing Images
    Ouyang, Lihan
    Guo, Guangmiao
    Fang, Leyuan
    Ghamisi, Pedram
    Yue, Jun
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] Detail Enhanced Change Detection in VHR Images Using a Self-Supervised Multiscale Hybrid Network
    Zheng, Dalong
    Wu, Zebin
    Liu, Jia
    Hung, Chih-Cheng
    Wei, Zhihui
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 3181 - 3196