Mangrove monitoring and extraction based on multi-source remote sensing data: a deep learning method based on SAR and optical image fusion

被引:0
|
作者
Yiheng Xie [1 ]
Xiaoping Rui [1 ]
Yarong Zou [2 ]
Heng Tang [3 ]
Ninglei Ouyang [1 ]
机构
[1] Hohai University,School of Earth Sciences and Engineering
[2] Ministry of Natural Resources,National Satellite Ocean Application Center
[3] Ministry of Natural Resources,Key Laboratory of Space and Ocean Remote Sensing and Application Research
关键词
image fusion; SAR image; optical image; mangrove; deep learning; attention mechanism;
D O I
10.1007/s13131-024-2356-1
中图分类号
学科分类号
摘要
Mangroves are indispensable to coastlines, maintaining biodiversity, and mitigating climate change. Therefore, improving the accuracy of mangrove information identification is crucial for their ecological protection. Aiming at the limited morphological information of synthetic aperture radar (SAR) images, which is greatly interfered by noise, and the susceptibility of optical images to weather and lighting conditions, this paper proposes a pixel-level weighted fusion method for SAR and optical images. Image fusion enhanced the target features and made mangrove monitoring more comprehensive and accurate. To address the problem of high similarity between mangrove forests and other forests, this paper is based on the U-Net convolutional neural network, and an attention mechanism is added in the feature extraction stage to make the model pay more attention to the mangrove vegetation area in the image. In order to accelerate the convergence and normalize the input, batch normalization (BN) layer and Dropout layer are added after each convolutional layer. Since mangroves are a minority class in the image, an improved cross-entropy loss function is introduced in this paper to improve the model’s ability to recognize mangroves. The AttU-Net model for mangrove recognition in high similarity environments is thus constructed based on the fused images. Through comparison experiments, the overall accuracy of the improved U-Net model trained from the fused images to recognize the predicted regions is significantly improved. Based on the fused images, the recognition results of the AttU-Net model proposed in this paper are compared with its benchmark model, U-Net, and the Dense-Net, Res-Net, and Seg-Net methods. The AttU-Net model captured mangroves’ complex structures and textural features in images more effectively. The average OA, F1-score, and Kappa coefficient in the four tested regions were 94.406%, 90.006%, and 84.045%, which were significantly higher than several other methods. This method can provide some technical support for the monitoring and protection of mangrove ecosystems.
引用
收藏
页码:110 / 121
页数:11
相关论文
共 50 条
  • [31] RESEARCH ON DROUTHT MONITORING IN SHANDONG PROVIENCE BASED ON MULTI-SOURCE REMOTE SENSING DATA
    Wan, Hong
    Guo, Peng
    Wang, Zhengdong
    Zhao, Tianjie
    Meng, Chunhong
    Yang, Gang
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 9428 - 9430
  • [32] Multi-source Remote Sensing Image Registration Based on Contourlet Transform and Multiple Feature Fusion
    Huan Liu
    Gen-Fu Xiao
    Yun-Lan Tan
    Chun-Juan Ouyang
    International Journal of Automation and Computing, 2019, 16 : 575 - 588
  • [33] A method for large-scale and high-resolution impervious surface extraction based on multi-source remote sensing and deep learning
    Sun G.
    Wang X.
    An N.
    Zhang A.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2023, 52 (02): : 272 - 282
  • [34] Multi-source Remote Sensing Image Registration Based on Contourlet Transform and Multiple Feature Fusion
    Liu, Huan
    Xiao, Gen-Fu
    Tan, Yun-Lan
    Ouyang, Chun-Juan
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2019, 16 (05) : 575 - 588
  • [35] Multi-source Remote Sensing Image Registration Based on Contourlet Transform and Multiple Feature Fusion
    Huan Liu
    Gen-Fu Xiao
    Yun-Lan Tan
    Chun-Juan Ouyang
    Machine Intelligence Research, 2019, (05) : 575 - 588
  • [36] Generator condition monitoring method based on SAE and multi-source data fusion
    Xing, Chao
    Xi, Xinze
    He, Xin
    Liu, Mingqun
    FRONTIERS IN ENERGY RESEARCH, 2023, 11
  • [37] Urban water extraction based on multi-source remote sensing images
    Fan, Yuancheng
    Zhou, Tinggang
    Li, Chengfan
    EPLWW3S 2011: 2011 INTERNATIONAL CONFERENCE ON ECOLOGICAL PROTECTION OF LAKES-WETLANDS-WATERSHED AND APPLICATION OF 3S TECHNOLOGY, VOL 3, 2011, : 312 - 315
  • [38] Multi-Source Feature-Fusion Method for the Seismic Data of Cultural Relics Based on Deep Learning
    He, Lin
    Wei, Quan
    Gong, Mengting
    Yang, Xiaofei
    Wei, Jianming
    SENSORS, 2024, 24 (14)
  • [39] Spatiotemporal Fusion of Remote Sensing Image Based on Deep Learning
    Wang, Xiaofei
    Wang, Xiaoyi
    JOURNAL OF SENSORS, 2020, 2020
  • [40] Multi-source remote sensing data fusion: status and trends
    Zhang, Jixian
    INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2010, 1 (01) : 5 - 24