RGAM: A novel network architecture for 3D point cloud semantic segmentation in indoor scenes

被引:21
|
作者
Chen, Xue-Tao [1 ,2 ]
Li, Ying [1 ,2 ]
Fan, Jia-Hao [1 ,2 ]
Wang, Rui [3 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[2] Jilin Univ, Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun 130012, Peoples R China
[3] Space Technol Jilin Ltd Co, Jilin 132013, Jilin, Peoples R China
关键词
3D Point cloud; Semantic segmentation; Deep neural network; Attention mechanism; CLASSIFICATION;
D O I
10.1016/j.ins.2021.04.069
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Three-dimensional (3D) point cloud semantic segmentation is an essential part of computer vision for scene comprehension. Nevertheless, due to their loss of detail, existing networks lack the ability to recognize complex scenes. This paper proposes a novel network architecture, called the ring grouping neural network with attention module (RGAM), which presents four improvements over the existing networks. First, novel multi-scale ring grouping learning is designed to extract the multi-scale neighborhood features without overlapped sampling, allowing the network to adapt to objects of different scales. Second, neighborhood information fusion is defined as the weighted sum of multiple neighborhood features, enabling the representation of each point to be considered in different neighborhoods. Third, in the global view, a spatial attention module is introduced among the neighborhoods, allowing long-range contextual information to be exploited for 3D point cloud semantic segmentation. Finally, a channel attention module is appended to the RGAM: the correlation of each channel with key information enhances the complex scene recognition ability of the RGAM. Experimental results on the challenging S3DIS, ScanNet, and NYU-V2 datasets demonstrate that the RGAM has stronger recognition ability than the existing networks based on several state-of-the-art algorithms for 3D point cloud semantic segmentation. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:87 / 103
页数:17
相关论文
共 50 条
  • [31] Semantic Context Encoding for Accurate 3D Point Cloud Segmentation
    Liu, Hao
    Guo, Yulan
    Ma, Yanni
    Lei, Yinjie
    Wen, Gongjian
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2045 - 2055
  • [32] PGCNet: patch graph convolutional network for point cloud segmentation of indoor scenes
    Yuliang Sun
    Yongwei Miao
    Jiazhou Chen
    Renato Pajarola
    The Visual Computer, 2020, 36 : 2407 - 2418
  • [33] Semantic and Geometric Labeling for Enhanced 3D Point Cloud Segmentation
    Perez-Perez, Yeritza
    Golparvar-Fard, Mani
    El-Rayes, Khaled
    CONSTRUCTION RESEARCH CONGRESS 2016: OLD AND NEW CONSTRUCTION TECHNOLOGIES CONVERGE IN HISTORIC SAN JUAN, 2016, : 2542 - 2552
  • [34] Transformer Enhanced Hierarchical 3D Point Cloud Semantic Segmentation
    Liu, Yaohua
    Ma, Yue
    Xu, Min
    2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
  • [35] Investigate Indistinguishable Points in Semantic Segmentation of 3D Point Cloud
    Xu, Mingye
    Zhou, Zhipeng
    Zhang, Junhao
    Qiao, Yu
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 3047 - 3055
  • [36] PGCNet: patch graph convolutional network for point cloud segmentation of indoor scenes
    Sun, Yuliang
    Miao, Yongwei
    Chen, Jiazhou
    Pajarola, Renato
    VISUAL COMPUTER, 2020, 36 (10-12): : 2407 - 2418
  • [37] Subdivision of Adjacent Areas for 3D Point Cloud Semantic Segmentation
    Haixia Xu
    Kaiyu Hu
    Yuting Xu
    Jiang Zhu
    Xu, Haixia (haixiaxu@xtu.edu.cn), 2025, 19 (01)
  • [38] Temporally Coherent 3D Point Cloud Video Segmentation in Generic Scenes
    Lin, Xiao
    Casas, Josep R.
    Pardas, Montse
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) : 3087 - 3099
  • [39] Semantic segmentation of 3D point cloud based on boundary point estimation and sparse convolution neural network
    Yang J.
    Zhang C.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2024, 58 (06): : 1121 - 1132
  • [40] A 3D INDOOR-OUTDOOR BENCHMARK DATASET FOR LoD3 BUILDING POINT CLOUD SEMANTIC SEGMENTATION
    Cao, Y.
    Scaioni, M.
    2ND GEOBENCH WORKSHOP ON EVALUATION AND BENCHMARKING OF SENSORS, SYSTEMS AND GEOSPATIAL DATA IN PHOTOGRAMMETRY AND REMOTE SENSING, VOL. 48-1, 2023, : 31 - 37