Multi-scale learnable key-channel attention network for point cloud classification and segmentation

被引:0
|
作者
Zhao, Jie [1 ]
Liu, Yian [1 ]
Wu, Bin [1 ]
机构
[1] Tianjin Chengjian Univ, Sch Comp & Informat Engn, Tianjin 300384, Peoples R China
关键词
3D semantic segmentation; Feature embedding; Channel attention mechanism; Hierarchical structure; CONVOLUTION;
D O I
10.1016/j.asoc.2024.111622
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 3D point cloud, a common format of 3D data, finds extensive applications in fields like remote sensing, surveying, robotics, and more. Addressing the challenges posed by insufficient weighted feature information and the offset between weighted results and task expectations in the attention mechanism, this paper proposes a Multi-scale Learnable Key-channel Attention Network (MLKNet). First, we introduce a feature feedback-repair module to mitigate the impact of information loss in the feature embedding process. This module aims to fully embed the original data into a high-dimensional feature space, ensuring a rich supply of feature information for subsequent transformer modules. Second, an efficient hierarchical local feature encoder extract and aggregate local features from point clouds at various scales, thereby significantly enhancing the model's capability to represent geometric structures. Third, a novel learnable key-channel attention module allows tasks to influence the feature selection and weighting process directly, make the highlighted features as close to task expectations as possible, effectively enhancing the network's perception of global semantic information. Our method was benchmarked on various tasks where we achieved overall accuracy (OA) of 92.3% on the ModelNet40 classification task and achieved instance mean intersection over union (ins. mIoU) of 87.6% on the ShapeNet-part segmentation task. The results indicate the superior performance of our method.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Multi-Scale Channel Attention Network for Prostate Segmentation
    Ding, Meiwen
    Lin, Zhiping
    Lee, Chau Hung
    Tan, Cher Heng
    Huang, Weimin
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (05) : 1754 - 1758
  • [2] Dilated Multi-scale Fusion for Point Cloud Classification and Segmentation
    Fan Guo
    Qingquan Ren
    Jin Tang
    Zhiyong Li
    [J]. Multimedia Tools and Applications, 2022, 81 : 6069 - 6090
  • [3] Dilated Multi-scale Fusion for Point Cloud Classification and Segmentation
    Guo, Fan
    Ren, Qingquan
    Tang, Jin
    Li, Zhiyong
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) : 6069 - 6090
  • [4] MSNet: Multi-Scale Convolutional Network for Point Cloud Classification
    Wang, Lei
    Huang, Yuchun
    Shan, Jie
    He, Liu
    [J]. REMOTE SENSING, 2018, 10 (04)
  • [5] MSFANet: Multi-Scale Strip Feature Attention Network for Cloud and Cloud Shadow Segmentation
    Chen, Kai
    Dai, Xin
    Xia, Min
    Weng, Liguo
    Hu, Kai
    Lin, Haifeng
    [J]. REMOTE SENSING, 2023, 15 (19)
  • [6] MNAT-Net: Multi-Scale Neighborhood Aggregation Transformer Network for Point Cloud Classification and Segmentation
    Wang, Xuchu
    Yuan, Yue
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 1 - 15
  • [7] MSP-Net: Multi-Scale Point Cloud Classification Network
    Bai, Jing
    Xu, Haojun
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (11): : 1917 - 1924
  • [8] Dual Attention Network for Point Cloud Classification and Segmentation
    Zhou, Ce
    Xie, Yuesong
    He, Xindong
    Yuan, Ting
    Ling, Qiang
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 6482 - 6486
  • [9] ATTENTION-BASED MULTI-SCALE GRAPH CONVOLUTION FOR POINT CLOUD SEMANTIC SEGMENTATION
    Akwensi, Perpetual Hope
    Wang, Ruisheng
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7515 - 7518
  • [10] Point Cloud Scene Segmentation Based on Dual Attention Mechanism and Multi-Scale Features
    Yu Lili
    Yu Haiyang
    He Zixin
    Chen Liangxuan
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (24)