MULTI-MODAL SELF-SUPERVISED LEARNING FOR BOOSTING CROP CLASSIFICATION USING SENTINEL2 AND PLANETSCOPE

被引:1
|
作者
Patnala, Ankit [1 ]
Stadtler, Scarlet [1 ]
Schultz, Martin G. [1 ]
Gall, Juergen [2 ]
机构
[1] Forschungszentrum Juelich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Bonn, Dept Informat Syst Artificial Intelligence, Bonn, Germany
关键词
Optical remote sensing; crop classification; contrastive learning; multi-modal contrastive learning; time-series; self-supervised learning;
D O I
10.1109/IGARSS52108.2023.10282665
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Remote sensing has enabled large-scale crop classification to understand agricultural ecosystems and estimate production yields. Since few years, machine learning is increasingly used for automated crop classification. However, most approaches apply novel algorithms to custom datasets containing information of few crop fields covering a small region and this often leads to poor models that lack generalization capability. Therefore in this work, inspired from the self-supervised learning approaches, we devised and compared different approaches for contrastive self-supervised learning using Sentinel2 and Planetscope data for crop classification. In addition, based on the dataset DENETHOR, we assembled our own dataset for the experiments.
引用
收藏
页码:2223 / 2226
页数:4
相关论文
共 50 条
  • [1] Self-Supervised Distilled Learning for Multi-modal Misinformation Identification
    Mu, Michael
    Das Bhattacharjee, Sreyasee
    Yuan, Junsong
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 2818 - 2827
  • [2] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Liu, Bo
    Song, Ruoyi
    Xiang, Yuejia
    Du, Junbo
    Ruan, Weijian
    Hu, Jinhui
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (11) : 2031 - 2033
  • [3] Self-Supervised Entity Alignment Based on Multi-Modal Contrastive Learning
    Bo Liu
    Ruoyi Song
    Yuejia Xiang
    Junbo Du
    Weijian Ruan
    Jinhui Hu
    [J]. IEEE/CAA Journal of Automatica Sinica, 2022, 9 (11) : 2031 - 2033
  • [4] Highly Interactive Self-Supervised Learning for Multi-Modal Trajectory Prediction
    Xie, Wenda
    Liu, Yahui
    Zhao, Hongxia
    Guo, Chao
    Dai, Xingyuan
    Lv, Yisheng
    [J]. IFAC PAPERSONLINE, 2024, 58 (10): : 231 - 236
  • [5] The Effectiveness of Self-supervised Pre-training for Multi-modal Endometriosis Classification
    Butler, David
    Wang, Hu
    Zhang, Yuan
    To, Minh-Son
    Condous, George
    Leonardi, Mathew
    Knox, Steven
    Avery, Jodie
    Hull, M. Louise
    Carneiro, Gustavo
    [J]. 2023 45TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2023,
  • [6] SELF-SUPERVISED LEARNING FOR CROP CLASSIFICATION USING PLANET FUSIONCaglar
    Senaras, Caglar
    Holden, Piers
    Davis, Timothy
    Rana, Akhil Singh
    Grady, Maddie
    Wania, Annett
    de Jeu, Richard
    [J]. 39TH INTERNATIONAL SYMPOSIUM ON REMOTE SENSING OF ENVIRONMENT ISRSE-39 FROM HUMAN NEEDS TO SDGS, VOL. 48-M-1, 2023, : 309 - 315
  • [7] Deep learning for multi-modal classification of cloud, shadow and land cover scenes in PlanetScope and Sentinel-2 imagery
    Shendryk, Yuri
    Rist, Yannik
    Ticehurst, Catherine
    Thorburn, Peter
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 157 : 124 - 136
  • [8] Self-Supervised Multi-Modal Learning for Collaborative Robotic Grasp-Throw
    Hou, Yanxu
    Fang, Zihan
    Li, Jun
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (05): : 4250 - 4256
  • [9] Self-supervised multi-modal fusion network for multi-modal thyroid ultrasound image diagnosis
    Xiang, Zhuo
    Zhuo, Qiuluan
    Zhao, Cheng
    Deng, Xiaofei
    Zhu, Ting
    Wang, Tianfu
    Jiang, Wei
    Lei, Baiying
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 150
  • [10] Self-supervised Multi-Modal Video Forgery Attack Detection
    Zhao, Chenhui
    Li, Xiang
    Younes, Rabih
    [J]. 2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,