CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

被引:1
|
作者
Li, Sheng [1 ]
Wang, Min [1 ,2 ,3 ]
Wu, Jia [1 ]
Sun, Shuo [1 ]
Zhuang, Zhihao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Anhui Jianzhu Univ, Sch Elect & Informat Engn, Hefei, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, 219 Ningliu Rd, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Ground-based cloud image segmentation; DeepLabV3+network; atrous spatial pyramid pooling module; attention feature alignment; NETWORK; IMAGES;
D O I
10.1080/01431161.2023.2240034
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The segmentation of ground-based cloud images is the basis for obtaining numerous cloud parameters. To achieve high-precision adaptive cloud image segmentation requirements, this study designs a lightweight ground-based cloud image adaptive segmentation method named CloudDeepLabV3+ that integrates multi-scale features aggregation and multi-level attention feature enhancement. Firstly, a novel lightweight EfficientNetV2-S is designed as a feature extraction backbone to reduce network parameters. Secondly, a heterogeneous receptive field splicing atrous spatial pyramid pooling module is designed. It enhances the correlation of information between layers, and realizes multiscale information fusion. The feature enhancement module based on the self-attention mechanism intensifies the representation of local and global features. Thirdly, the feature alignment module based on the attention mechanism is constructed to pull deep and shallow features for alignment. Finally, we implement ablation study on the key components of method and comparison experiment with other advanced methods using five evaluation metrics. Results show that the key components play an important role in multiscale information fusion. It promotes the accuracy of cloud image feature extraction while reducing the loss of detailed features. Generalization performance verification indicates the excellent performance of the proposed model in advanced cloud feature extraction and cloud-mask generation.
引用
收藏
页码:4836 / 4856
页数:21
相关论文
共 50 条
  • [1] Surgical instrument segmentation based on multi-scale and multi-level feature network
    Wang, Yiming
    Qiu, Zhongxi
    Hu, Yan
    Chen, Hao
    Ye, Fangfu
    Liu, Jiang
    [J]. 2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 2672 - 2675
  • [2] Crowd Counting based on Multi-level Multi-scale Feature
    Wu, Di
    Fan, Zheyi
    Yi, Shuhan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (19) : 21891 - 21901
  • [3] Crowd Counting based on Multi-level Multi-scale Feature
    Di Wu
    Zheyi Fan
    Shuhan Yi
    [J]. Applied Intelligence, 2023, 53 : 21891 - 21901
  • [4] A multi-scale and multi-level feature aggregation network for crowd counting
    Zhu, Fushun
    Yan, Hua
    Chen, Xinyue
    Li, Tong
    Zhang, Zhengyu
    [J]. NEUROCOMPUTING, 2021, 423 : 46 - 56
  • [5] Lightweight Semantic Segmentation Algorithm Based on Multi-level Feature Fusion
    Huo, Guang
    Wang, Yan-Ran
    Liu, Yan-Chang
    Li, Ru-Yuan
    [J]. Journal of Network Intelligence, 2023, 8 (04): : 1440 - 1449
  • [6] Salient Object Detection Based on Multi-scale Feature Extraction and Multi-level Feature Fusion
    Li, Lingli
    Meng, Lingbing
    Li, Jinbao
    [J]. Gongcheng Kexue Yu Jishu/Advanced Engineering Sciences, 2021, 53 (01): : 170 - 177
  • [7] Point Set Multi-Level Aggregation Feature Extraction Based on Multi-Scale Max Pooling and LDA for Point Cloud Classification
    Tong, Guofeng
    Li, Yong
    Zhang, Weilong
    Chen, Dong
    Zhang, Zhenxin
    Yang, Jingchao
    Zhang, Jianjun
    [J]. REMOTE SENSING, 2019, 11 (23)
  • [8] Multi-Level and Multi-Scale Feature Aggregation Network for Semantic Segmentation in Vehicle-Mounted Scenes
    Liao, Yong
    Liu, Qiong
    [J]. SENSORS, 2021, 21 (09)
  • [9] Multi-Scale Neighborhood Feature Extraction and Aggregation for Point Cloud Segmentation
    Li, Dawei
    Shi, Guoliang
    Wu, Yuhao
    Yang, Yanping
    Zhao, Mingbo
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (06) : 2175 - 2191
  • [10] LiDAR Point Cloud Semantic Segmentation Method Based on Multi-scale Contextual Feature
    Liu, Fuchun
    Chen, Xujian
    Huang, Zewen
    Liu, Zeyong
    [J]. 2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 477 - 482