CloudDeepLabV3+: a lightweight ground-based cloud segmentation method based on multi-scale feature aggregation and multi-level attention feature enhancement

被引:1
|
作者
Li, Sheng [1 ]
Wang, Min [1 ,2 ,3 ]
Wu, Jia [1 ]
Sun, Shuo [1 ]
Zhuang, Zhihao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing, Peoples R China
[2] Anhui Jianzhu Univ, Sch Elect & Informat Engn, Hefei, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, 219 Ningliu Rd, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Ground-based cloud image segmentation; DeepLabV3+network; atrous spatial pyramid pooling module; attention feature alignment; NETWORK; IMAGES;
D O I
10.1080/01431161.2023.2240034
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The segmentation of ground-based cloud images is the basis for obtaining numerous cloud parameters. To achieve high-precision adaptive cloud image segmentation requirements, this study designs a lightweight ground-based cloud image adaptive segmentation method named CloudDeepLabV3+ that integrates multi-scale features aggregation and multi-level attention feature enhancement. Firstly, a novel lightweight EfficientNetV2-S is designed as a feature extraction backbone to reduce network parameters. Secondly, a heterogeneous receptive field splicing atrous spatial pyramid pooling module is designed. It enhances the correlation of information between layers, and realizes multiscale information fusion. The feature enhancement module based on the self-attention mechanism intensifies the representation of local and global features. Thirdly, the feature alignment module based on the attention mechanism is constructed to pull deep and shallow features for alignment. Finally, we implement ablation study on the key components of method and comparison experiment with other advanced methods using five evaluation metrics. Results show that the key components play an important role in multiscale information fusion. It promotes the accuracy of cloud image feature extraction while reducing the loss of detailed features. Generalization performance verification indicates the excellent performance of the proposed model in advanced cloud feature extraction and cloud-mask generation.
引用
收藏
页码:4836 / 4856
页数:21
相关论文
共 50 条
  • [41] CafeNet : A Novel Multi-Scale Context Aggregation and Multi-Level Foreground Enhancement Network for Polyp Segmentation
    Ji, Zhanlin
    Li, Xiaoyu
    Wang, Zhiwu
    Zhang, Haiyang
    Yuan, Na
    Zhang, Xueji
    Ganchev, Ivan
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (05)
  • [42] Pedestrian detection algorithm based on multi-scale feature extraction and attention feature fusion
    Xia, Hao
    Ma, Jun
    Ou, Jiayu
    Lv, Xinyao
    Bai, Chengjie
    [J]. DIGITAL SIGNAL PROCESSING, 2022, 121
  • [43] A medical image segmentation method for rectal tumors based on multi-scale feature retention and multiple attention mechanisms
    Zhao, Jumin
    Liu, Linjun
    Yang, Xiaotang
    Cui, Yanfen
    Li, Dengao
    Zhang, Huiting
    Zhang, Kenan
    [J]. MEDICAL PHYSICS, 2024, 51 (05) : 3275 - 3291
  • [44] MRFA-Net: Kidney Segmentation Method Based on Multi-Scale Feature Fusion and Residual Full Attention
    Chen, Junlin
    Fan, Hongbo
    Shao, Dangguo
    Dai, Shuting
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [45] Efficient spine segmentation network based on multi-scale feature extraction and multi-dimensional spatial attention
    Xu, Guohao
    Wang, Chuantao
    Li, Zhuoyuan
    Zhai, Jiliang
    Wang, Saishuo
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (02)
  • [46] Cloud/shadow segmentation based on multi-level feature enhanced network for remote sensing imagery
    Miao, Shoukuan
    Xia, Min
    Qian, Ming
    Zhang, Yonghong
    Liu, Jia
    Lin, Haifeng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) : 5940 - 5960
  • [47] MAFA-net: pedestrian detection network based on multi-scale attention feature aggregation
    Hao Xia
    Honglin Wan
    Jiayu Ou
    Jun Ma
    Xinyao Lv
    Chengjie Bai
    [J]. Applied Intelligence, 2022, 52 : 7686 - 7699
  • [48] MAFA-net: pedestrian detection network based on multi-scale attention feature aggregation
    Xia, Hao
    Wan, Honglin
    Ou, Jiayu
    Ma, Jun
    Lv, Xinyao
    Bai, Chengjie
    [J]. APPLIED INTELLIGENCE, 2022, 52 (07) : 7686 - 7699
  • [49] Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation
    Hua, Zhongwei
    Qi, Lizhe
    Du, Daming
    Jiang, Wenxuan
    Sun, Yunquan
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3639 - 3644
  • [50] Self-Attention-based Multi-Scale Feature Fusion Network for Road Ponding Segmentation
    Yang, Shangyu
    Zhang, Ronghui
    Sun, Wencai
    Chen, Shengru
    Ye, Cong
    Wu, Hao
    Li, Mengran
    [J]. 2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,