Multi-scale learnable key-channel attention network for point cloud classification and segmentation

被引:0
|
作者
Zhao, Jie [1 ]
Liu, Yian [1 ]
Wu, Bin [1 ]
机构
[1] Tianjin Chengjian Univ, Sch Comp & Informat Engn, Tianjin 300384, Peoples R China
关键词
3D semantic segmentation; Feature embedding; Channel attention mechanism; Hierarchical structure; CONVOLUTION;
D O I
10.1016/j.asoc.2024.111622
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The 3D point cloud, a common format of 3D data, finds extensive applications in fields like remote sensing, surveying, robotics, and more. Addressing the challenges posed by insufficient weighted feature information and the offset between weighted results and task expectations in the attention mechanism, this paper proposes a Multi-scale Learnable Key-channel Attention Network (MLKNet). First, we introduce a feature feedback-repair module to mitigate the impact of information loss in the feature embedding process. This module aims to fully embed the original data into a high-dimensional feature space, ensuring a rich supply of feature information for subsequent transformer modules. Second, an efficient hierarchical local feature encoder extract and aggregate local features from point clouds at various scales, thereby significantly enhancing the model's capability to represent geometric structures. Third, a novel learnable key-channel attention module allows tasks to influence the feature selection and weighting process directly, make the highlighted features as close to task expectations as possible, effectively enhancing the network's perception of global semantic information. Our method was benchmarked on various tasks where we achieved overall accuracy (OA) of 92.3% on the ModelNet40 classification task and achieved instance mean intersection over union (ins. mIoU) of 87.6% on the ShapeNet-part segmentation task. The results indicate the superior performance of our method.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Micro-Gear Point Cloud Segmentation Based on Multi-Scale Point Transformer
    Su, Yizhou
    Wang, Xunwei
    Qi, Guanghao
    Lei, Baozhen
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (10):
  • [42] Point attention network for point cloud semantic segmentation
    Dayong Ren
    Zhengyi Wu
    Jiawei Li
    Piaopiao Yu
    Jie Guo
    Mingqiang Wei
    Yanwen Guo
    [J]. Science China Information Sciences, 2022, 65
  • [43] Point attention network for point cloud semantic segmentation
    Ren, Dayong
    Wu, Zhengyi
    Li, Jiawei
    Yu, Piaopiao
    Guo, Jie
    Wei, Mingqiang
    Guo, Yanwen
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2022, 65 (09)
  • [44] Point attention network for point cloud semantic segmentation
    Dayong REN
    Zhengyi WU
    Jiawei LI
    Piaopiao YU
    Jie GUO
    Mingqiang WEI
    Yanwen GUO
    [J]. Science China(Information Sciences), 2022, (09) : 99 - 112
  • [45] A Novel Multi-Scale Channel Attention-Guided Neural Network for Brain Stroke Lesion Segmentation
    Li, Zhihua
    Xing, Qiwei
    Li, Yanfang
    He, Wei
    Miao, Yu
    Ji, Bai
    Shi, Weili
    Jiang, Zhengang
    [J]. IEEE ACCESS, 2023, 11 (66050-66062) : 66050 - 66062
  • [46] MLFNet- Point Cloud Semantic Segmentation Convolution Network Based on Multi-Scale Feature Fusion
    Yang, Jingfang
    Zou, Bochang
    Qiu, Huadong
    Li, Zhi
    [J]. IEEE ACCESS, 2021, 9 : 44950 - 44962
  • [47] A Point Cloud Upsampling Adversarial Network Based on Residual Multi-Scale Off-Set Attention
    Shen B.
    Li L.
    Hu X.
    Guo S.
    Huang J.
    Liang Z.
    [J]. Virtual Reality and Intelligent Hardware, 2023, 5 (01): : 81 - 91
  • [48] Multi-scale triple-attention network for pixelwise crack segmentation
    Yang, Lei
    Bai, Suli
    Liu, Yanhong
    Yu, Hongnian
    [J]. AUTOMATION IN CONSTRUCTION, 2023, 150
  • [49] Attention based multi-scale nested network for biomedical image segmentation
    Cheng, Dapeng
    Deng, Jia
    Xiao, Jinjie
    Yanyan, Mao
    Kang, Jialong
    Gai, Jiale
    Zhang, Baosheng
    Zhao, Feng
    [J]. HELIYON, 2024, 10 (14)
  • [50] Multi-scale feature fusion network with local attention for lung segmentation
    Xie, Yinghua
    Zhou, Yuntong
    Wang, Chen
    Ma, Yanshan
    Yang, Ming
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 119