Large-scale rice mapping under spatiotemporal heterogeneity using multi-temporal SAR images and explainable deep learning

被引:1
|
作者
Ge, Ji [1 ,2 ,3 ]
Zhang, Hong [1 ,2 ,3 ]
Zuo, Lijun [1 ,2 ,3 ]
Xu, Lu [1 ,2 ,3 ]
Jiang, Jingling [1 ,2 ,3 ]
Song, Mingyang [1 ,2 ,3 ]
Ding, Yinhaibin [1 ,2 ,3 ]
Xie, Yazhe [1 ,2 ,3 ]
Wu, Fan [1 ,2 ,3 ]
Wang, Chao [1 ,2 ,3 ]
Huang, Wenjiang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
关键词
Synthetic aperture radar; Rice mapping; Explainable deep learning; Feature importance; UNSUPERVISED DOMAIN ADAPTATION; MULTISOURCE; RESOLUTION; RADAR; MAP;
D O I
10.1016/j.isprsjprs.2024.12.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Timely and accurate mapping of rice cultivation distribution is crucial for ensuring global food security and achieving SDG2. From a global perspective, rice areas display high heterogeneity in spatial pattern and SAR timeseries characteristics, posing substantial challenges to deep learning (DL) models' performance, efficiency, and transferability. Moreover, due to their "black box" nature, DL often lack interpretability and credibility. To address these challenges, this paper constructs the first SAR rice dataset with spatiotemporal heterogeneity and proposes an explainable, lightweight model for rice area extraction, the eXplainable Mamba UNet (XM-UNet). The dataset is based on the 2023 multi-temporal Sentinel-1 data, covering diverse rice samples from the United States, Kenya, and Vietnam. A Temporal Feature Importance Explainer (TFI-Explainer) based on the Selective State Space Model is designed to enhance adaptability to the temporal heterogeneity of rice and the model's interpretability. This explainer, coupled with the DL model, provides interpretations of the importance of SAR temporal features and facilitates crucial time phase screening. To overcome the spatial heterogeneity of rice, an Attention Sandglass Layer (ASL) combining CNN and self-attention mechanisms is designed to enhance the local spatial feature extraction capabilities. Additionally, the Parallel Visual State Space Layer (PVSSL) utilizes 2D-Selective-Scan (SS2D) cross-scanning to capture the global spatial features of rice multi-directionally, significantly reducing computational complexity through parallelization. Experimental results demonstrate that the XM-UNet adapts well to the spatiotemporal heterogeneity of rice globally, with OA and F1-score of 94.26 % and 90.73 %, respectively. The model is extremely lightweight, with only 0.190 M parameters and 0.279 GFLOPs. Mamba's selective scanning facilitates feature screening, and its integration with CNN effectively balances rice's local and global spatial characteristics. The interpretability experiments prove that the explanations of the importance of the temporal features provided by the model are crucial for guiding rice distribution mapping and filling a gap in the related field. The code is available in https://github.com/SAR-RICE/XM-UNet.
引用
收藏
页码:395 / 412
页数:18
相关论文
共 50 条
  • [21] Multi-Temporal InSAR Parallel Processing for Sentinel-1 Large-Scale Surface Deformation Mapping
    Duan, Wei
    Zhang, Hong
    Wang, Chao
    Tang, Yixian
    REMOTE SENSING, 2020, 12 (22) : 1 - 20
  • [22] Towards interpreting multi-temporal deep learning models in crop mapping
    Xu, Jinfan
    Yang, Jie
    Xiong, Xingguo
    Li, Haifeng
    Huang, Jingfeng
    Ting, K. C.
    Ying, Yibin
    Lin, Tao
    REMOTE SENSING OF ENVIRONMENT, 2021, 264
  • [23] ANALYSIS OF RICE GROWTH USING MULTI-TEMPORAL RADARSAT-2 QUAD-POL SAR IMAGES
    Wu, Fan
    Zhang, Bo
    Zhang, Hong
    Wang, Chao
    Tang, Yixian
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2012, 18 (08): : 997 - 1007
  • [24] Mapping permafrost landscape features using object-based image classification of multi-temporal SAR images
    Wang, Lingxiao
    Marzahn, Philip
    Bernier, Monique
    Ludwig, Ralf
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 141 : 10 - 29
  • [25] Identifying rice stress on a regional scale from multi-temporal satellite images using a Bayesian method
    Liu, Meiling
    Wang, Tiejun
    Skidmore, Andrew K.
    Liu, Xiangnan
    Li, Mengmeng
    ENVIRONMENTAL POLLUTION, 2019, 247 : 488 - 498
  • [26] Large-Scale Mapping of Maize Plant Density Using Multi-Temporal Optical and Radar Data: Models, Potential and Application Strategy
    Xiao, Jing
    Zhang, Yuan
    Du, Xin
    Li, Qiangzi
    Wang, Hongyan
    Wang, Yueting
    Xu, Jingyuan
    Dong, Yong
    Shen, Yunqi
    Yan, Sifeng
    Gong, Shuguang
    Hu, Haoxuan
    PLANTS-BASEL, 2025, 14 (01):
  • [27] Mapping seasonal flooding in forested wetlands using multi-temporal radarsat SAR
    Townsend, PA
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2001, 67 (07): : 857 - 864
  • [28] Monitoring of Land-Cover Moisture Using Multi-Temporal Sar Images
    Yoon, Boyeol
    Lee, Kwangjae
    Kim, Younsoo
    Kim, Yongseung
    KOREAN JOURNAL OF REMOTE SENSING, 2006, 22 (05) : 433 - 437
  • [29] FOREST MAPPING USING MULTI-TEMPORAL POLARIMETRIC SAR DATA IN SOUTHWEST CHINA
    Shao, Yun
    Zhang, Fengli
    Xu, Maosong
    Xia, Zhongsheng
    Xie, Chou
    Li, Kun
    Wan, Zi
    Touzi, Ridha
    2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2011, : 134 - 137
  • [30] Fast Mapping of Large-Scale Landslides in Sentinel-1 SAR Images Using SPAUNet
    Shi, Xianjian
    Wu, Yifei
    Guo, Qing
    Li, Ni
    Lin, Zhiyong
    Qiu, Hua
    Pan, Bin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 7992 - 8006