Semantic segmentation of 3D point cloud based on self-attention feature fusion group convolutional neural network

被引:0
|
作者
Yang, Jun [1 ,2 ]
Li, Bozan [2 ]
机构
[1] Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou,730070, China
[2] School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou,730070, China
关键词
Semantic Segmentation;
D O I
10.37188/OPE.20223007.0840
中图分类号
学科分类号
摘要
The existing algorithms ignore the profound relationship between global single point features and local geometric features. This results in the lack of discriminative captured local geometric information and increases the difficulty of effectively identifying complex shape categories. This paper proposes a semantic segmentation algorithm for three-dimensional point clouds based on a self-attention feature fusion group convolutional neural network. First, the proxy point graph convolution of lightweight network is designed to extract the local geometric features of the point cloud. Then, the group convolution operation is added to reduce the amount of calculation and complexity and enhance the richness of features with less redundant information. Second, the feature information exchange between different branches is carried out through the Transformer module to ensure mutual compensation between the global and local geometric features and to enhance the completeness of features. Then, the underlying semantic features of the point cloud are fused with the original point cloud to expand the local neighborhood perception field and obtain high-level context semantic information. Finally, the features are input into the segmentation module to complete fine-grained semantic segmentation. The experimental results show that the segmentation accuracy reaches 79.3% and 56.6% in the S3DIS and SemanticKITTI datasets, respectively. This algorithm can extract the key feature information from a 3D point cloud using fewer network parameters and exhibits high robustness of semantic segmentation. © 2022, Science Press. All right reserved.
引用
收藏
页码:840 / 853
相关论文
共 50 条
  • [21] Semantic segmentation of 3D point cloud based on boundary point estimation and sparse convolution neural network
    Yang, Jun
    Zhang, Chen
    [J]. Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (06): : 1121 - 1132
  • [22] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    [J]. PATTERN RECOGNITION, 2020, 107
  • [23] Dynamic-Scale Graph Convolutional Network for Semantic Segmentation of 3D Point Cloud
    Xiu, Haoyi
    Shinohara, Takayuki
    Matsuoka, Masashi
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2019), 2019, : 271 - 278
  • [24] Fast Point Voxel Convolution Neural Network with Selective Feature Fusion for Point Cloud Semantic Segmentation
    Wang, Xu
    Li, Yuyan
    Duan, Ye
    [J]. ADVANCES IN VISUAL COMPUTING (ISVC 2021), PT I, 2021, 13017 : 319 - 330
  • [25] Point Cloud Feature Extraction Network Based on 3D Feature Dynamic Fusion
    Sun, Liujie
    Zhai, Renjie
    Wang, Wenju
    Pang, Maoran
    [J]. Computer Engineering and Applications, 2023, 59 (24) : 209 - 215
  • [26] A Deep Neural Network Using Double Self-Attention Mechanism for ALS Point Cloud Segmentation
    Yu, Lili
    Yu, Haiyang
    Yang, Shuai
    [J]. IEEE ACCESS, 2022, 10 : 29878 - 29889
  • [27] Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification
    Qing, Yuhao
    Huang, Quanzhen
    Feng, Liuyan
    Qi, Yueyan
    Liu, Wenyi
    [J]. REMOTE SENSING, 2022, 14 (03)
  • [28] Semantic Segmentation Method of Point Cloud in Automatic Driving Scene Based on Self-attention Mechanism
    Wang, Dafang
    Shang, Hai
    Cao, Jiang
    Wang, Tao
    Xia, Xiangteng
    Han, Yulin
    [J]. Qiche Gongcheng/Automotive Engineering, 2022, 44 (11): : 1656 - 1664
  • [29] Hierarchical Depthwise Graph Convolutional Neural Network for 3D Semantic Segmentation of Point Clouds
    Liang, Zhidong
    Yang, Ming
    Deng, Liuyuan
    Wang, Chunxiang
    Wang, Bing
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 8152 - 8158
  • [30] Lightweight Self-Attention Network for Semantic Segmentation
    Zhou, Yan
    Zhou, Haibin
    Li, Nanjun
    Li, Jianxun
    Wang, Dongli
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,