CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

被引:1
|
作者
Li, Sheng [1 ]
Wang, Min [1 ,2 ,3 ]
Wu, Jia [1 ]
Sun, Shuo [1 ]
Zhuang, Zhihao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Anhui Jianzhu Univ, Sch Elect & Informat Engn, Hefei, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, 219 Ningliu Rd, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Ground-based cloud image segmentation; DeepLabV3+network; atrous spatial pyramid pooling module; attention feature alignment; NETWORK; IMAGES;
D O I
10.1080/01431161.2023.2240034
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The segmentation of ground-based cloud images is the basis for obtaining numerous cloud parameters. To achieve high-precision adaptive cloud image segmentation requirements, this study designs a lightweight ground-based cloud image adaptive segmentation method named CloudDeepLabV3+ that integrates multi-scale features aggregation and multi-level attention feature enhancement. Firstly, a novel lightweight EfficientNetV2-S is designed as a feature extraction backbone to reduce network parameters. Secondly, a heterogeneous receptive field splicing atrous spatial pyramid pooling module is designed. It enhances the correlation of information between layers, and realizes multiscale information fusion. The feature enhancement module based on the self-attention mechanism intensifies the representation of local and global features. Thirdly, the feature alignment module based on the attention mechanism is constructed to pull deep and shallow features for alignment. Finally, we implement ablation study on the key components of method and comparison experiment with other advanced methods using five evaluation metrics. Results show that the key components play an important role in multiscale information fusion. It promotes the accuracy of cloud image feature extraction while reducing the loss of detailed features. Generalization performance verification indicates the excellent performance of the proposed model in advanced cloud feature extraction and cloud-mask generation.
引用
收藏
页码:4836 / 4856
页数:21
相关论文
共 50 条
  • [31] MFA-UNet: a vessel segmentation method based on multi-scale feature fusion and attention module
    Cao, Juan
    Chen, Jiaran
    Gu, Yuanyuan
    Liu, Jinjia
    [J]. FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [32] Human pose estimation based on feature enhancement and multi-scale feature fusion
    Cao, Dandan
    Liu, Weibin
    Xing, Weiwei
    Wei, Xiang
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (03) : 643 - 650
  • [33] A Road Crack Segmentation Method Based on Transformer and Multi-Scale Feature Fusion
    Xu, Yang
    Xia, Yonghua
    Zhao, Quai
    Yang, Kaihua
    Li, Qiang
    [J]. ELECTRONICS, 2024, 13 (12)
  • [34] Human pose estimation based on feature enhancement and multi-scale feature fusion
    Dandan Cao
    Weibin Liu
    Weiwei Xing
    Xiang Wei
    [J]. Signal, Image and Video Processing, 2023, 17 : 643 - 650
  • [35] Multi-Scale Feature Aggregation Network for Water Area Segmentation
    Hu, Kai
    Li, Meng
    Xia, Min
    Lin, Haifeng
    [J]. REMOTE SENSING, 2022, 14 (01)
  • [36] Fault Feature Extraction Method for Cascaded H-bridge Multi-level Inverter Based on Multi-scale OGLPE
    Zhang, Bide
    Kong, Lingyu
    Peng, Liwei
    Mei, Ting
    [J]. Gaodianya Jishu/High Voltage Engineering, 2020, 46 (08): : 2732 - 2739
  • [37] Segmentation of aerial image with multi-scale feature and attention model
    Ning, Qian
    Hu, Shi-Yu
    Lei, Yin-Jie
    Chen, Bing-Cai
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2020, 37 (06): : 1218 - 1224
  • [38] A Lightweight Road Defect Detection Method Based on Multi-scale Hybrid Feature Fusion
    Kuang, Jin
    Liu, Dong
    Lv, Hong
    Xu, Xinyue
    Zhang, Lingrong
    [J]. THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [39] MMS-Net: Multi-level multi-scale feature extraction network for medical image segmentation
    Zhao, Chang
    Lv, Wenbing
    Zhang, Xiang
    Yu, Zimin
    Wang, Shunfang
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [40] MSLF-Net: A Multi-Scale and Multi-Level Feature Fusion Net for Diabetic Retinopathy Segmentation
    Yan, Haitao
    Xie, Jiexin
    Zhu, Deliang
    Jia, Lukuan
    Guo, Shijie
    [J]. DIAGNOSTICS, 2022, 12 (12)