Large-scale rice mapping under spatiotemporal heterogeneity using multi-temporal SAR images and explainable deep learning

被引:1
|
作者
Ge, Ji [1 ,2 ,3 ]
Zhang, Hong [1 ,2 ,3 ]
Zuo, Lijun [1 ,2 ,3 ]
Xu, Lu [1 ,2 ,3 ]
Jiang, Jingling [1 ,2 ,3 ]
Song, Mingyang [1 ,2 ,3 ]
Ding, Yinhaibin [1 ,2 ,3 ]
Xie, Yazhe [1 ,2 ,3 ]
Wu, Fan [1 ,2 ,3 ]
Wang, Chao [1 ,2 ,3 ]
Huang, Wenjiang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
关键词
Synthetic aperture radar; Rice mapping; Explainable deep learning; Feature importance; UNSUPERVISED DOMAIN ADAPTATION; MULTISOURCE; RESOLUTION; RADAR; MAP;
D O I
10.1016/j.isprsjprs.2024.12.021
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Timely and accurate mapping of rice cultivation distribution is crucial for ensuring global food security and achieving SDG2. From a global perspective, rice areas display high heterogeneity in spatial pattern and SAR timeseries characteristics, posing substantial challenges to deep learning (DL) models' performance, efficiency, and transferability. Moreover, due to their "black box" nature, DL often lack interpretability and credibility. To address these challenges, this paper constructs the first SAR rice dataset with spatiotemporal heterogeneity and proposes an explainable, lightweight model for rice area extraction, the eXplainable Mamba UNet (XM-UNet). The dataset is based on the 2023 multi-temporal Sentinel-1 data, covering diverse rice samples from the United States, Kenya, and Vietnam. A Temporal Feature Importance Explainer (TFI-Explainer) based on the Selective State Space Model is designed to enhance adaptability to the temporal heterogeneity of rice and the model's interpretability. This explainer, coupled with the DL model, provides interpretations of the importance of SAR temporal features and facilitates crucial time phase screening. To overcome the spatial heterogeneity of rice, an Attention Sandglass Layer (ASL) combining CNN and self-attention mechanisms is designed to enhance the local spatial feature extraction capabilities. Additionally, the Parallel Visual State Space Layer (PVSSL) utilizes 2D-Selective-Scan (SS2D) cross-scanning to capture the global spatial features of rice multi-directionally, significantly reducing computational complexity through parallelization. Experimental results demonstrate that the XM-UNet adapts well to the spatiotemporal heterogeneity of rice globally, with OA and F1-score of 94.26 % and 90.73 %, respectively. The model is extremely lightweight, with only 0.190 M parameters and 0.279 GFLOPs. Mamba's selective scanning facilitates feature screening, and its integration with CNN effectively balances rice's local and global spatial characteristics. The interpretability experiments prove that the explanations of the importance of the temporal features provided by the model are crucial for guiding rice distribution mapping and filling a gap in the related field. The code is available in https://github.com/SAR-RICE/XM-UNet.
引用
收藏
页码:395 / 412
页数:18
相关论文
共 50 条
  • [41] Operational Flood Mapping Using Multi-Temporal Sentinel-1 SAR Images: A Case Study from Bangladesh
    Uddin, Kabir
    Matin, Mir A.
    Meyer, Franz J.
    REMOTE SENSING, 2019, 11 (13)
  • [42] Small Scale Crater Detection Based on Deep Learning with Multi-temporal Samples of High-resolution Images
    Jin, Yanmin
    He, Fan
    Liu, Shijie
    Tong, Xiaohua
    2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [43] Rice Growth Monitoring Using Multi-Temporal GF-1 Images
    Wang, Jing
    Lu, Bihui
    Yu, Kun
    Tian, Miao
    Huang, Xiaojun
    Wang, Zhiming
    2017 6TH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS, 2017, : 306 - 310
  • [44] Dynamic Mapping of Paddy Rice Using Multi-Temporal Landsat Data Based on a Deep Semantic Segmentation Model
    Du, Meiqi
    Huang, Jingfeng
    Wei, Pengliang
    Yang, Lingbo
    Chai, Dengfeng
    Peng, Dailiang
    Sha, Jinming
    Sun, Weiwei
    Huang, Ran
    AGRONOMY-BASEL, 2022, 12 (07):
  • [45] A Multi-Temporal Network for Improving Semantic Segmentation of Large-Scale Landsat Imagery
    Yang, Xuan
    Zhang, Bing
    Chen, Zhengchao
    Bai, Yongqing
    Chen, Pan
    REMOTE SENSING, 2022, 14 (19)
  • [46] Evaluating vegetation recovery following large-scale forest fires in Borneo and northeastern China using multi-temporal NOAA/AVHRR images
    Idris, MH
    Kuraji, K
    Suzuki, M
    JOURNAL OF FOREST RESEARCH, 2005, 10 (02) : 101 - 111
  • [47] Extraction of Rice Information Using Multi-temporal SAR Data Based on Feature Optimization
    Yu F.
    Lü Z.
    Sui Z.
    Li J.
    Gai Y.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (03): : 259 - 265
  • [48] Large Scale Crop Classification from Multi-temporal and Multi-spectral Satellite Images
    Yilmaz, Ismail
    Imamoglu, Mumin
    Ozbulak, Gokhan
    Kahraman, Fatih
    Aptoula, Erchan
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [49] Deep learning for classification of time series spectral images using combined multi-temporal and spectral features
    Xu, Jun-Li
    Hugelier, Siewert
    Zhu, Hongyan
    Gowen, Aoife A.
    Analytica Chimica Acta, 2021, 1143 : 9 - 20
  • [50] Deep learning for classification of time series spectral images using combined multi-temporal and spectral features
    Xu, Jun-Li
    Hugelier, Siewert
    Zhu, Hongyan
    Gowen, Aoife A.
    ANALYTICA CHIMICA ACTA, 2021, 1143 : 9 - 20