Semantic segmentation of 3D point cloud based on self-attention feature fusion group convolutional neural network

被引:0
|
作者
Yang, Jun [1 ,2 ]
Li, Bozan [2 ]
机构
[1] Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou,730070, China
[2] School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou,730070, China
关键词
Semantic Segmentation;
D O I
10.37188/OPE.20223007.0840
中图分类号
学科分类号
摘要
The existing algorithms ignore the profound relationship between global single point features and local geometric features. This results in the lack of discriminative captured local geometric information and increases the difficulty of effectively identifying complex shape categories. This paper proposes a semantic segmentation algorithm for three-dimensional point clouds based on a self-attention feature fusion group convolutional neural network. First, the proxy point graph convolution of lightweight network is designed to extract the local geometric features of the point cloud. Then, the group convolution operation is added to reduce the amount of calculation and complexity and enhance the richness of features with less redundant information. Second, the feature information exchange between different branches is carried out through the Transformer module to ensure mutual compensation between the global and local geometric features and to enhance the completeness of features. Then, the underlying semantic features of the point cloud are fused with the original point cloud to expand the local neighborhood perception field and obtain high-level context semantic information. Finally, the features are input into the segmentation module to complete fine-grained semantic segmentation. The experimental results show that the segmentation accuracy reaches 79.3% and 56.6% in the S3DIS and SemanticKITTI datasets, respectively. This algorithm can extract the key feature information from a 3D point cloud using fewer network parameters and exhibits high robustness of semantic segmentation. © 2022, Science Press. All right reserved.
引用
收藏
页码:840 / 853
相关论文
共 50 条
  • [31] MFFNet: multimodal feature fusion network for point cloud semantic segmentation
    Ren, Dayong
    Li, Jiawei
    Wu, Zhengyi
    Guo, Jie
    Wei, Mingqiang
    Guo, Yanwen
    [J]. VISUAL COMPUTER, 2024, 40 (08): : 5155 - 5167
  • [32] Point Cloud Semantic Segmentation Network Based on Multi-Scale Feature Fusion
    Du, Jing
    Jiang, Zuning
    Huang, Shangfeng
    Wang, Zongyue
    Su, Jinhe
    Su, Songjian
    Wu, Yundong
    Cai, Guorong
    [J]. SENSORS, 2021, 21 (05) : 1 - 20
  • [33] A 3D Convolutional Neural Network for Volumetric Image Semantic Segmentation
    Lu, Hongya
    Wang, Haifeng
    Zhang, Qianqian
    Yoon, Sang Won
    Won, Daehan
    [J]. 25TH INTERNATIONAL CONFERENCE ON PRODUCTION RESEARCH MANUFACTURING INNOVATION: CYBER PHYSICAL MANUFACTURING, 2019, 39 : 422 - 428
  • [34] 3D Point Cloud Classification and Segmentation Model Based on Graph Convolutional Network
    Hou Xiangdan
    Yu Xixin
    Liu Hongpu
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (18)
  • [35] JS']JSMNet: Improving Indoor Point Cloud Semantic and Instance Segmentation through Self-Attention and Multiscale Fusion
    Xu, Shuochen
    Zhang, Zhenxin
    [J]. GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 195 - 201
  • [36] FGCN: Deep Feature-based Graph Convolutional Network for Semantic Segmentation of Urban 3D Point Clouds
    Khan, Saqib Ali
    Shi, Yilei
    Shahzad, Muhammad
    Zhu, Xiao Xiang
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 778 - 787
  • [37] 3DDACNN: 3D dense attention convolutional neural network for point cloud based object recognition
    Han, Xian-Feng
    Huang, Xin-Yi
    Sun, Shi-Jie
    Wang, Ming-Jie
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (08) : 6655 - 6671
  • [38] 3DDACNN: 3D dense attention convolutional neural network for point cloud based object recognition
    Xian-Feng Han
    Xin-Yi Huang
    Shi-Jie Sun
    Ming-Jie Wang
    [J]. Artificial Intelligence Review, 2022, 55 : 6655 - 6671
  • [39] Lightweight Semantic Segmentation Network based on Attention Feature Fusion
    Kuang, Xianyan
    Liu, Ping
    Chen, Yixi
    Zhang, Jianhua
    [J]. ENGINEERING LETTERS, 2023, 31 (04)
  • [40] Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation
    Xie Xinchen
    Li, Chen
    Tian, Lihua
    [J]. 2022 IEEE WORLD AI IOT CONGRESS (AIIOT), 2022, : 9 - 14