RGAM: A novel network architecture for 3D point cloud semantic segmentation in indoor scenes

被引:21
|
作者
Chen, Xue-Tao [1 ,2 ]
Li, Ying [1 ,2 ]
Fan, Jia-Hao [1 ,2 ]
Wang, Rui [3 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Peoples R China
[2] Jilin Univ, Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun 130012, Peoples R China
[3] Space Technol Jilin Ltd Co, Jilin 132013, Jilin, Peoples R China
关键词
3D Point cloud; Semantic segmentation; Deep neural network; Attention mechanism; CLASSIFICATION;
D O I
10.1016/j.ins.2021.04.069
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Three-dimensional (3D) point cloud semantic segmentation is an essential part of computer vision for scene comprehension. Nevertheless, due to their loss of detail, existing networks lack the ability to recognize complex scenes. This paper proposes a novel network architecture, called the ring grouping neural network with attention module (RGAM), which presents four improvements over the existing networks. First, novel multi-scale ring grouping learning is designed to extract the multi-scale neighborhood features without overlapped sampling, allowing the network to adapt to objects of different scales. Second, neighborhood information fusion is defined as the weighted sum of multiple neighborhood features, enabling the representation of each point to be considered in different neighborhoods. Third, in the global view, a spatial attention module is introduced among the neighborhoods, allowing long-range contextual information to be exploited for 3D point cloud semantic segmentation. Finally, a channel attention module is appended to the RGAM: the correlation of each channel with key information enhances the complex scene recognition ability of the RGAM. Experimental results on the challenging S3DIS, ScanNet, and NYU-V2 datasets demonstrate that the RGAM has stronger recognition ability than the existing networks based on several state-of-the-art algorithms for 3D point cloud semantic segmentation. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:87 / 103
页数:17
相关论文
共 50 条
  • [21] 3D semantic segmentation using deep learning for large-scale indoor point cloud
    Chen Hui
    Xu Peng
    Zuo Yipeng
    Wang Weina
    PROCEEDINGS OF 2019 14TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), 2019, : 1650 - 1655
  • [22] Semantic segmentation of 3D indoor LiDAR point clouds through feature pyramid architecture search
    Lin, Haojia
    Wu, Shangbin
    Chen, Yiping
    Li, Wen
    Luo, Zhipeng
    Guo, Yulan
    Wang, Cheng
    Li, Jonathan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 177 (177) : 279 - 290
  • [23] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [24] Detection based object labeling of 3D point cloud for indoor scenes
    Liu, Wei
    Li, Shaozi
    Cao, Donglin
    Su, Songzhi
    Ji, Rongrong
    NEUROCOMPUTING, 2016, 174 : 1101 - 1106
  • [25] Hierarchical SVM for Semantic Segmentation of 3D Point Clouds for Infrastructure Scenes
    Mansour, Mohamed
    Martens, Jan
    Blankenbach, Joerg
    INFRASTRUCTURES, 2024, 9 (05)
  • [26] Dynamic-Scale Graph Convolutional Network for Semantic Segmentation of 3D Point Cloud
    Xiu, Haoyi
    Shinohara, Takayuki
    Matsuoka, Masashi
    2019 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2019), 2019, : 271 - 278
  • [27] Deep learning network for indoor point cloud semantic segmentation with transferability
    Li, Luping
    Chen, Jian
    Su, Xing
    Han, Haoying
    Fan, Chao
    AUTOMATION IN CONSTRUCTION, 2024, 168
  • [28] 3D point cloud semantic segmentation: state of the art and challenges
    Wang Y.
    Hu Y.
    Kong Q.
    Zeng H.
    Zhang L.
    Fan B.
    Gongcheng Kexue Xuebao/Chinese Journal of Engineering, 2023, 45 (10): : 1653 - 1664
  • [29] A survey on weakly supervised 3D point cloud semantic segmentation
    Wang, Jingyi
    Liu, Yu
    Tan, Hanlin
    Zhang, Maojun
    IET COMPUTER VISION, 2024, 18 (03) : 329 - 342
  • [30] Few-shot 3D Point Cloud Semantic Segmentation
    Zhao, Na
    Chua, Tat-Seng
    Lee, Gim Hee
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8869 - 8878