Semantic segmentation of 3D point cloud based on self-attention feature fusion group convolutional neural network

被引:0
|
作者
Yang, Jun [1 ,2 ]
Li, Bozan [2 ]
机构
[1] Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou,730070, China
[2] School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou,730070, China
关键词
Semantic Segmentation;
D O I
10.37188/OPE.20223007.0840
中图分类号
学科分类号
摘要
The existing algorithms ignore the profound relationship between global single point features and local geometric features. This results in the lack of discriminative captured local geometric information and increases the difficulty of effectively identifying complex shape categories. This paper proposes a semantic segmentation algorithm for three-dimensional point clouds based on a self-attention feature fusion group convolutional neural network. First, the proxy point graph convolution of lightweight network is designed to extract the local geometric features of the point cloud. Then, the group convolution operation is added to reduce the amount of calculation and complexity and enhance the richness of features with less redundant information. Second, the feature information exchange between different branches is carried out through the Transformer module to ensure mutual compensation between the global and local geometric features and to enhance the completeness of features. Then, the underlying semantic features of the point cloud are fused with the original point cloud to expand the local neighborhood perception field and obtain high-level context semantic information. Finally, the features are input into the segmentation module to complete fine-grained semantic segmentation. The experimental results show that the segmentation accuracy reaches 79.3% and 56.6% in the S3DIS and SemanticKITTI datasets, respectively. This algorithm can extract the key feature information from a 3D point cloud using fewer network parameters and exhibits high robustness of semantic segmentation. © 2022, Science Press. All right reserved.
引用
收藏
页码:840 / 853
相关论文
共 50 条
  • [1] Self-attention feature fusion network for semantic segmentation
    Zhou, Zhen
    Zhou, Yan
    Wang, Dongli
    Mu, Jinzhen
    Zhou, Haibin
    [J]. NEUROCOMPUTING, 2021, 453 : 50 - 59
  • [2] Multi-Feature 3D Road Point Cloud Semantic Segmentation Method Based on Convolutional Neural Network
    Zhang Aiwu
    Liu Lulu
    Zhang Xizhen
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2020, 47 (04):
  • [3] Feature fusion network based on attention mechanism for 3D semantic segmentation of point clouds
    Zhou, Heng
    Fang, Zhijun
    Gao, Yongbin
    Huang, Bo
    Zhong, Cengsi
    Shang, Ruoxi
    [J]. PATTERN RECOGNITION LETTERS, 2020, 133 : 327 - 333
  • [4] 3D Thyroid Segmentation in CT Using Self-attention Convolutional Neural Network
    He, Xiuxiu
    Guo, Bang Jun
    Lei, Yang
    Liu, Yingzi
    Wang, Tonghe
    Curran, Walter J.
    Zhang, Long Jiang
    Liu, Tian
    Yang, Xiaofeng
    [J]. MEDICAL IMAGING 2020: COMPUTER-AIDED DIAGNOSIS, 2020, 11314
  • [5] Cross self-attention network for 3D point cloud
    Wang, Gaihua
    Zhai, Qianyu
    Liu, Hong
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 247
  • [6] Point cloud semantic segmentation based on local feature fusion and multilayer attention network
    Wen, Junjie
    Ma, Jie
    Zhao, Yuehua
    Nie, Tong
    Sun, Mengxuan
    Fan, Ziming
    [J]. IET COMPUTER VISION, 2024, 18 (03) : 381 - 392
  • [7] SSA-PointNet++: A Space Self-Attention CNN for the Semantic Segmentation of 3D Point Cloud
    Wu, Jun
    Cui, Yue
    Zhao, Xuemei
    Chen, Ruixing
    Xu, Gang
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (03): : 437 - 448
  • [8] DAPnet: A Double Self-Attention Convolutional Network for Point Cloud Semantic Labeling
    Chen, Li
    Chen, Weiye
    Xu, Zewei
    Huang, Haozhe
    Wang, Shaowen
    Zhu, Qing
    Li, Haifeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 9680 - 9691
  • [9] 3D Point Cloud Semantic Segmentation Network Based on Coding Feature Learning
    Tong, Guofeng
    Liu, Yongxu
    Peng, Hao
    Shao, Yuyuan
    [J]. Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (04): : 313 - 326
  • [10] Adaptive offset self-attention network for 3D point cloud
    Wang, Gaihua
    Wang, Nengyuan
    Li, Qi
    Liu, Hong
    Zhai, Qianyu
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)