CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

被引:1
|
作者
Li, Sheng [1 ]
Wang, Min [1 ,2 ,3 ]
Wu, Jia [1 ]
Sun, Shuo [1 ]
Zhuang, Zhihao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Anhui Jianzhu Univ, Sch Elect & Informat Engn, Hefei, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, 219 Ningliu Rd, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Ground-based cloud image segmentation; DeepLabV3+network; atrous spatial pyramid pooling module; attention feature alignment; NETWORK; IMAGES;
D O I
10.1080/01431161.2023.2240034
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The segmentation of ground-based cloud images is the basis for obtaining numerous cloud parameters. To achieve high-precision adaptive cloud image segmentation requirements, this study designs a lightweight ground-based cloud image adaptive segmentation method named CloudDeepLabV3+ that integrates multi-scale features aggregation and multi-level attention feature enhancement. Firstly, a novel lightweight EfficientNetV2-S is designed as a feature extraction backbone to reduce network parameters. Secondly, a heterogeneous receptive field splicing atrous spatial pyramid pooling module is designed. It enhances the correlation of information between layers, and realizes multiscale information fusion. The feature enhancement module based on the self-attention mechanism intensifies the representation of local and global features. Thirdly, the feature alignment module based on the attention mechanism is constructed to pull deep and shallow features for alignment. Finally, we implement ablation study on the key components of method and comparison experiment with other advanced methods using five evaluation metrics. Results show that the key components play an important role in multiscale information fusion. It promotes the accuracy of cloud image feature extraction while reducing the loss of detailed features. Generalization performance verification indicates the excellent performance of the proposed model in advanced cloud feature extraction and cloud-mask generation.
引用
收藏
页码:4836 / 4856
页数:21
相关论文
共 50 条
  • [21] Semantic Segmentation Method Based on Residual and Multi-Scale Feature Fusion
    Xiu, Chunbo
    Su, Huan
    Su, Xuemiao
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 2078 - 2083
  • [22] Underwater Image Enhancement Based on Multi-Scale Feature Fusion and Attention Network
    Liu, Yuzhen
    Liu, Meiyi
    Lin, Sen
    Tao, Zhiyong
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2023, 35 (05): : 685 - 695
  • [23] Pavement crack detection method based on multi-scale feature enhancement
    Zhai, Jun-Zhi
    Sun, Zhao-Yun
    Pei, Li-Li
    Huyan, Ju
    Li, Wei
    [J]. Jiaotong Yunshu Gongcheng Xuebao/Journal of Traffic and Transportation Engineering, 2023, 23 (01): : 291 - 308
  • [24] LMANet: A Lightweight Asymmetric Semantic Segmentation Network Based on Multi-Scale Feature Extraction
    Chen, Hui
    Xiao, Zhexuan
    Ge, Bin
    Li, Xuedi
    [J]. ELECTRONICS, 2024, 13 (17)
  • [25] A lightweight network for traffic sign recognition based on multi-scale feature and attention mechanism
    Wei, Wei
    Zhang, Lili
    Yang, Kang
    Li, Jing
    Cui, Ning
    Han, Yucheng
    Zhang, Ning
    Yang, Xudong
    Tan, Hongxin
    Wang, Kai
    [J]. HELIYON, 2024, 10 (04)
  • [26] A Lightweight YOLO Object Detection Algorithm Based on Bidirectional Multi-Scale Feature Enhancement
    Liu, Qunpo
    Zhang, Jingwen
    Zhang, Zhuoran
    Bu, Xuhui
    Hanajima, Naohiko
    [J]. ADVANCED THEORY AND SIMULATIONS, 2024, 7 (05)
  • [27] Lightweight silkworm recognition based on Multi-scale feature fusion
    Wen, Chunming
    Wen, Jie
    Li, Jianheng
    Luo, Yunyun
    Chen, Minbo
    Xiao, Zhanpeng
    Xu, Qing
    Liang, Xiang
    An, Hui
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 200
  • [28] LM-DeeplabV3+: A Lightweight Image Segmentation Algorithm Based on Multi-Scale Feature Interaction
    Hou, Xinyu
    Chen, Peng
    Gu, Haishuo
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (04):
  • [29] Efficient Multi-Scale Feature Extraction for Lightweight Semantic Segmentation
    Liu, Yun
    Lu, Cheng-Ze
    Li, Shi-Jie
    Zhang, Le
    Wu, Yu-Huan
    Cheng, Ming-Ming
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (07): : 1517 - 1528
  • [30] A Novel Hybridoma Cell Segmentation Method Based on Multi-Scale Feature Fusion and Dual Attention Network
    Lu, Jianfeng
    Ren, Hangpeng
    Shi, Mengtao
    Cui, Chen
    Zhang, Shanqing
    Emam, Mahmoud
    Li, Li
    [J]. ELECTRONICS, 2023, 12 (04)