Large-scale rice mapping under spatiotemporal heterogeneity using multi-temporal SAR images and explainable deep learning

被引:1
|
作者
Ge, Ji [1 ,2 ,3 ]
Zhang, Hong [1 ,2 ,3 ]
Zuo, Lijun [1 ,2 ,3 ]
Xu, Lu [1 ,2 ,3 ]
Jiang, Jingling [1 ,2 ,3 ]
Song, Mingyang [1 ,2 ,3 ]
Ding, Yinhaibin [1 ,2 ,3 ]
Xie, Yazhe [1 ,2 ,3 ]
Wu, Fan [1 ,2 ,3 ]
Wang, Chao [1 ,2 ,3 ]
Huang, Wenjiang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
关键词
Synthetic aperture radar; Rice mapping; Explainable deep learning; Feature importance; UNSUPERVISED DOMAIN ADAPTATION; MULTISOURCE; RESOLUTION; RADAR; MAP;
D O I
10.1016/j.isprsjprs.2024.12.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Timely and accurate mapping of rice cultivation distribution is crucial for ensuring global food security and achieving SDG2. From a global perspective, rice areas display high heterogeneity in spatial pattern and SAR timeseries characteristics, posing substantial challenges to deep learning (DL) models' performance, efficiency, and transferability. Moreover, due to their "black box" nature, DL often lack interpretability and credibility. To address these challenges, this paper constructs the first SAR rice dataset with spatiotemporal heterogeneity and proposes an explainable, lightweight model for rice area extraction, the eXplainable Mamba UNet (XM-UNet). The dataset is based on the 2023 multi-temporal Sentinel-1 data, covering diverse rice samples from the United States, Kenya, and Vietnam. A Temporal Feature Importance Explainer (TFI-Explainer) based on the Selective State Space Model is designed to enhance adaptability to the temporal heterogeneity of rice and the model's interpretability. This explainer, coupled with the DL model, provides interpretations of the importance of SAR temporal features and facilitates crucial time phase screening. To overcome the spatial heterogeneity of rice, an Attention Sandglass Layer (ASL) combining CNN and self-attention mechanisms is designed to enhance the local spatial feature extraction capabilities. Additionally, the Parallel Visual State Space Layer (PVSSL) utilizes 2D-Selective-Scan (SS2D) cross-scanning to capture the global spatial features of rice multi-directionally, significantly reducing computational complexity through parallelization. Experimental results demonstrate that the XM-UNet adapts well to the spatiotemporal heterogeneity of rice globally, with OA and F1-score of 94.26 % and 90.73 %, respectively. The model is extremely lightweight, with only 0.190 M parameters and 0.279 GFLOPs. Mamba's selective scanning facilitates feature screening, and its integration with CNN effectively balances rice's local and global spatial characteristics. The interpretability experiments prove that the explanations of the importance of the temporal features provided by the model are crucial for guiding rice distribution mapping and filling a gap in the related field. The code is available in https://github.com/SAR-RICE/XM-UNet.
引用
收藏
页码:395 / 412
页数:18
相关论文
共 50 条
  • [31] Polarimetric analysis of multi-temporal RADARSAT-2 SAR images for wheat monitoring and mapping
    Xu, Juan
    Li, Zhen
    Tian, Bangsen
    Huang, Lei
    Chen, Quan
    Fu, Sitao
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2014, 35 (10) : 3840 - 3858
  • [32] MAPPING EXTENSION AND MAGNITUDE OF CHANGES INDUCED BY CYCLONE IDAI WITH MULTI-TEMPORAL LANDSAT AND SAR IMAGES
    Amisse, C.
    Jijon-Palma, M. E.
    Centeno, J. A. S.
    2020 IEEE LATIN AMERICAN GRSS & ISPRS REMOTE SENSING CONFERENCE (LAGIRS), 2020, : 574 - 578
  • [33] TEMPORA-SPATIAL-PROBABILISTIC MODEL BASED FOR MAPPING PADDY RICE USING MULTI-TEMPORAL LANDSAT IMAGES
    Sun, Peijun
    Xie, Dengfeng
    Zhang, Jinshui
    Zhu, Xiufang
    Wei, Fenghua
    Yuan, Zhoumiqi
    2014 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2014, : 2086 - 2089
  • [34] Rice Fields Mapping in Fragmented Area Using Multi-Temporal HJ-1A/B CCD Images
    Wang, Jing
    Huang, Jingfeng
    Zhang, Kangyu
    Li, Xinxing
    She, Bao
    Wei, Chuanwen
    Gao, Jian
    Song, Xiaodong
    REMOTE SENSING, 2015, 7 (04): : 3467 - 3488
  • [35] Multi-Temporal Data Fusion in MS and SAR Images Using the Dynamic Time Warping Method for Paddy Rice Classification
    Lei, Tsu Chiang
    Wan, Shiuan
    Wu, You Cheng
    Wang, Hsin-Ping
    Hsieh, Chia-Wen
    AGRICULTURE-BASEL, 2022, 12 (01):
  • [36] REGIONAL SCALE CROP MAPPING USING MULTI-TEMPORAL SATELLITE IMAGERY
    Kussul, N.
    Skakun, S.
    Shelestov, A.
    Lavreniuk, M.
    Yailymov, B.
    Kussul, O.
    36TH INTERNATIONAL SYMPOSIUM ON REMOTE SENSING OF ENVIRONMENT, 2015, 47 (W3): : 45 - 52
  • [37] Classification of multi-temporal SAR images for rice crops using combined Entropy Decomposition and Support Vector Machine technique
    Tan, C.-P.
    Koay, J.-Y.
    Lim, K.-S.
    Ewe, H.-T.
    Chuah, H.-T.
    PROGRESS IN ELECTROMAGNETICS RESEARCH-PIER, 2007, 71 : 19 - 39
  • [38] Deep Learning for Integrated Speckle Reduction and Super-Resolution in Multi-Temporal SAR
    Bu, Lijing
    Zhang, Jiayu
    Zhang, Zhengpeng
    Yang, Yin
    Deng, Mingjun
    REMOTE SENSING, 2024, 16 (01)
  • [39] Deep learning networks for selection of measurement pixels in multi-temporal SAR interferometric processing
    Tiwari, Ashutosh
    Narayan, Avadh Bihari
    Dikshit, Onkar
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 166 : 169 - 182
  • [40] DEEP LEARNING FOR SUPER-RESOLUTION OF UNREGISTERED MULTI-TEMPORAL SATELLITE IMAGES
    Molini, Andrea Bordone
    Valsesia, Diego
    Fracastoro, Giulia
    Magli, Enrico
    2019 10TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING - EVOLUTION IN REMOTE SENSING (WHISPERS), 2019,