Mangrove monitoring and extraction based on multi-source remote sensing data: a deep learning method based on SAR and optical image fusion

被引:0
|
作者
Yiheng Xie [1 ]
Xiaoping Rui [1 ]
Yarong Zou [2 ]
Heng Tang [3 ]
Ninglei Ouyang [1 ]
机构
[1] Hohai University,School of Earth Sciences and Engineering
[2] Ministry of Natural Resources,National Satellite Ocean Application Center
[3] Ministry of Natural Resources,Key Laboratory of Space and Ocean Remote Sensing and Application Research
关键词
image fusion; SAR image; optical image; mangrove; deep learning; attention mechanism;
D O I
10.1007/s13131-024-2356-1
中图分类号
学科分类号
摘要
Mangroves are indispensable to coastlines, maintaining biodiversity, and mitigating climate change. Therefore, improving the accuracy of mangrove information identification is crucial for their ecological protection. Aiming at the limited morphological information of synthetic aperture radar (SAR) images, which is greatly interfered by noise, and the susceptibility of optical images to weather and lighting conditions, this paper proposes a pixel-level weighted fusion method for SAR and optical images. Image fusion enhanced the target features and made mangrove monitoring more comprehensive and accurate. To address the problem of high similarity between mangrove forests and other forests, this paper is based on the U-Net convolutional neural network, and an attention mechanism is added in the feature extraction stage to make the model pay more attention to the mangrove vegetation area in the image. In order to accelerate the convergence and normalize the input, batch normalization (BN) layer and Dropout layer are added after each convolutional layer. Since mangroves are a minority class in the image, an improved cross-entropy loss function is introduced in this paper to improve the model’s ability to recognize mangroves. The AttU-Net model for mangrove recognition in high similarity environments is thus constructed based on the fused images. Through comparison experiments, the overall accuracy of the improved U-Net model trained from the fused images to recognize the predicted regions is significantly improved. Based on the fused images, the recognition results of the AttU-Net model proposed in this paper are compared with its benchmark model, U-Net, and the Dense-Net, Res-Net, and Seg-Net methods. The AttU-Net model captured mangroves’ complex structures and textural features in images more effectively. The average OA, F1-score, and Kappa coefficient in the four tested regions were 94.406%, 90.006%, and 84.045%, which were significantly higher than several other methods. This method can provide some technical support for the monitoring and protection of mangrove ecosystems.
引用
收藏
页码:110 / 121
页数:11
相关论文
共 50 条
  • [1] Mangrove monitoring and extraction based on multi-source remote sensing data: a deep learning method based on SAR and optical image fusion
    Yiheng Xie
    Xiaoping Rui
    Yarong Zou
    Heng Tang
    Ninglei Ouyang
    Acta Oceanologica Sinica, 2024, 43 (09) : 110 - 121
  • [2] Multi-Source Remote Sensing Image Fusion Method Based on Sparse representation
    Yu, Xianchuan
    Gao, Guanyin
    INTERNATIONAL SYMPOSIUM ON OPTOELECTRONIC TECHNOLOGY AND APPLICATION 2014: IMAGE PROCESSING AND PATTERN RECOGNITION, 2014, 9301
  • [3] Automatic extraction of urban impervious surfaces based on deep learning and multi-source remote sensing data
    Huang, Fenghua
    Yu, Ying
    Feng, Tinghao
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 16 - 27
  • [4] Construction of a drought monitoring model using deep learning based on multi-source remote sensing data
    Shen, Runping
    Huang, Anqi
    Li, Bolun
    Guo, Jia
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2019, 79 : 48 - 57
  • [5] Remote Sensing Monitoring of Grasslands Based on Adaptive Feature Fusion with Multi-Source Data
    Wang, Weitao
    Ma, Qin
    Huang, Jianxi
    Feng, Quanlong
    Zhao, Yuanyuan
    Guo, Hao
    Chen, Boan
    Li, Chenxi
    Zhang, Yuxin
    REMOTE SENSING, 2022, 14 (03)
  • [6] Data fusion of multi-source remote sensing based on level set method and application to urban road extraction
    Key Laboratory for Wave Scattering and Remote Sensing Information, Fudan University, Shanghai 200433, China
    Dianzi Yu Xinxi Xuebao, 2007, 6 (1464-1470):
  • [7] A new method for multi-source remote sensing image fusion
    Zhang, SY
    Wang, PQ
    Chen, XY
    Zhang, X
    IGARSS 2005: IEEE International Geoscience and Remote Sensing Symposium, Vols 1-8, Proceedings, 2005, : 3948 - 3951
  • [9] MULTI-SOURCE REMOTE SENSING IMAGE FUSION BASED ON SUPPORT VECTOR MACHINE
    Zhao Shu-he
    Feng Xue-zhi
    Kang Gao-ding
    Ramadan, Elnazir
    CHINESE GEOGRAPHICAL SCIENCE, 2002, 12 (03) : 244 - 248
  • [10] Multi-source remote sensing image fusion based on support vector machine
    Shu-he Zhao
    Feng Xue-zhi
    Guo-ding Kang
    Elnazir Ramadan
    Chinese Geographical Science, 2002, 12 : 244 - 248