MSFANet: Multi-Scale Strip Feature Attention Network for Cloud and Cloud Shadow Segmentation

被引:16
|
作者
Chen, Kai [1 ]
Dai, Xin [1 ]
Xia, Min [1 ]
Weng, Liguo [1 ]
Hu, Kai [1 ]
Lin, Haifeng [2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210037, Peoples R China
关键词
cloud; cloud shadow; attention; image segmentation; MASK;
D O I
10.3390/rs15194853
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Cloud and cloud shadow segmentation is one of the most critical challenges in remote sensing image processing. Because of susceptibility to factors such as disturbance from terrain features and noise, as well as a poor capacity to generalize, conventional deep learning networks, when directly used to cloud and cloud shade detection and division, have a tendency to lose fine features and spatial data, leading to coarse segmentation of cloud and cloud shadow borders, false detections, and omissions of targets. To address the aforementioned issues, a multi-scale strip feature attention network (MSFANet) is proposed. This approach uses Resnet18 as the backbone for obtaining semantic data at multiple levels. It incorporates a particular attention module that we name the deep-layer multi-scale pooling attention module (DMPA), aimed at extracting multi-scale contextual semantic data, deep channel feature information, and deep spatial feature information. Furthermore, a skip connection module named the boundary detail feature perception module (BDFP) is introduced to promote information interaction and fusion between adjacent layers of the backbone network. This module performs feature exploration on both the height and width dimensions of the characteristic pattern to enhance the recovery of boundary detail intelligence of the detection targets. Finally, during the decoding phase, a self-attention module named the cross-layer self-attention feature fusion module (CSFF) is employed to direct the aggregation of deeplayer semantic feature and shallow detail feature. This approach facilitates the extraction of feature information to the maximum extent while conducting image restoration. The experimental outcomes unequivocally prove the efficacy of our network in effectively addressing complex cloud-covered scenes, showcasing good performance across the cloud and cloud shadow datasets, the HRC_WHU dataset, and the SPARCS dataset. Our model outperforms existing methods in terms of segmentation accuracy, underscoring its paramount importance in the field of cloud recognition research.
引用
收藏
页数:25
相关论文
共 50 条
  • [31] Multi-scale Network with Attentional Multi-resolution Fusion for Point Cloud Semantic Segmentation
    Li, Yuyan
    Duan, Ye
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3980 - 3986
  • [32] Dual-Branch Network for Cloud and Cloud Shadow Segmentation
    Lu, Chen
    Xia, Min
    Qian, Ming
    Chen, Binyu
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [33] Collaborative Attention Guided Multi-Scale Feature Fusion Network for Medical Image Segmentation
    Xu, Zhenghua
    Tian, Biao
    Liu, Shijie
    Wang, Xiangtao
    Yuan, Di
    Gu, Junhua
    Chen, Junyang
    Lukasiewicz, Thomas
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02): : 1857 - 1871
  • [34] MS-FANet: Multi-scale feature attention network for liver tumor segmentation
    Chen, Ying
    Zheng, Cheng
    Zhang, Wei
    Lin, Hongping
    Chen, Wang
    Zhang, Guimei
    Xu, Guohui
    Wu, Fang
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 163
  • [35] Scattered Train Bolt Point Cloud Segmentation Based on Hierarchical Multi-Scale Feature Learning
    Zeng, Ni
    Li, Jinlong
    Zhang, Yu
    Gao, Xiaorong
    Luo, Lin
    [J]. SENSORS, 2023, 23 (04)
  • [36] Semantic Segmentation of Point Cloud Scene via Multi-Scale Feature Aggregation and Adaptive Fusion
    Guo, Baoyun
    Sun, Xiaokai
    Li, Cailin
    Sun, Na
    Wang, Yue
    Yao, Yukai
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2024, 90 (09): : 553 - 563
  • [37] Dilated Multi-scale Fusion for Point Cloud Classification and Segmentation
    Fan Guo
    Qingquan Ren
    Jin Tang
    Zhiyong Li
    [J]. Multimedia Tools and Applications, 2022, 81 : 6069 - 6090
  • [38] A Multi-Scale Channel Attention Network for Prostate Segmentation
    Ding, Meiwen
    Lin, Zhiping
    Lee, Chau Hung
    Tan, Cher Heng
    Huang, Weimin
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (05) : 1754 - 1758
  • [39] Segmentation of aerial image with multi-scale feature and attention model
    Ning Q.
    Hu S.-Y.
    Lei Y.-J.
    Chen B.-C.
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2020, 37 (06): : 1218 - 1224
  • [40] Cloud/shadow segmentation based on multi-level feature enhanced network for remote sensing imagery
    Miao, Shoukuan
    Xia, Min
    Qian, Ming
    Zhang, Yonghong
    Liu, Jia
    Lin, Haifeng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) : 5940 - 5960