SEMANTIC SEGMENTATION OF INDOOR POINT CLOUDS USING CONVOLUTIONAL NEURAL NETWORK

被引:14
|
作者
Babacan, K. [1 ]
Chen, L. [1 ]
Sohn, G. [1 ]
机构
[1] York Univ Toronto, Dept Earth & Space Sci & Engn, N York, ON M3J 1P3, Canada
关键词
Indoor Modelling; Semantic Segmentation; Mobile Laser; Point Cloud; Deep Learning; Convolutional Neural Network; 3D RECONSTRUCTION;
D O I
10.5194/isprs-annals-IV-4-W4-101-2017
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As Building Information Modelling (BIM) thrives, geometry becomes no longer sufficient; an ever increasing variety of semantic information is needed to express an indoor model adequately. On the other hand, for the existing buildings, automatically generating semantically enriched BIM from point cloud data is in its infancy. The previous research to enhance the semantic content rely on frameworks in which some specific rules and/or features that are hand coded by specialists. These methods immanently lack generalization and easily break in different circumstances. On this account, a generalized framework is urgently needed to automatically and accurately generate semantic information. Therefore we propose to employ deep learning techniques for the semantic segmentation of point clouds into meaningful parts. More specifically, we build a volumetric data representation in order to efficiently generate the high number of training samples needed to initiate a convolutional neural network architecture. The feedforward propagation is used in such a way to perform the classification in voxel level for achieving semantic segmentation. The method is tested both for a mobile laser scanner point cloud, and a larger scale synthetically generated data. We also demonstrate a case study, in which our method can be effectively used to leverage the extraction of planar surfaces in challenging cluttered indoor environments.
引用
收藏
页码:101 / 108
页数:8
相关论文
共 50 条
  • [21] On the contextual aspects of using deep convolutional neural network for semantic image segmentation
    Wang, Chunlai
    Mauch, Lukas
    Saxena, Mehul Manoj
    Yang, Bin
    JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (05)
  • [22] SEMANTIC SEGMENTATION OF INDOOR 3D POINT CLOUDS BY JOINT OPTIMIZATION OF GEOMETRIC FEATURES AND NEURAL NETWORKS
    Yao, M. M.
    Li, X. M.
    Wang, W. X.
    Xie, L. F.
    Tang, S. J.
    17TH 3D GEOINFO CONFERENCE, 2022, 10-4 (W2): : 305 - 310
  • [23] GSIP: Green Semantic Segmentation of Large-Scale Indoor Point Clouds
    Zhang, Min
    Kadam, Pranav
    Liu, Shan
    Kuo, C. -C. Jay
    PATTERN RECOGNITION LETTERS, 2022, 164 : 9 - 15
  • [24] Improved semantic segmentation network using normal vector guidance for LiDAR point clouds
    Kim, Minsung
    Oh, Inyoung
    Yun, Dongho
    Ko, Kwanghee
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2023, 10 (06) : 2332 - 2344
  • [25] PUConv: Upsampling convolutional network for point cloud semantic segmentation
    Lu Jian
    Cheng Haozhe
    Luo Maoxin
    Liu Tong
    Zhang Kaibing
    ELECTRONICS LETTERS, 2020, 56 (09) : 435 - 437
  • [26] Color guided convolutional network for point cloud semantic segmentation
    Yang, Jing
    Li, Haozhe
    Jiang, Zhou
    Zhang, Dong
    Yue, Xiaoli
    Du, Shaoyi
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2022, 19 (03):
  • [27] PFCN: a fully convolutional network for point cloud semantic segmentation
    Lu, Jian
    Liu, Tong
    Luo, Maoxin
    Cheng, Haozhe
    Zhang, Kaibing
    ELECTRONICS LETTERS, 2019, 55 (20) : 1088 - 1089
  • [28] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [29] Study on semantic image segmentation based on convolutional neural network
    Li, Lin-Hui
    Qian, Bo
    Lian, Jing
    Zheng, Wei-Na
    Zhou, Ya-Fu
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2017, 33 (06) : 3397 - 3404
  • [30] Convolutional Neural Network for the Semantic Segmentation of Remote Sensing Images
    Muhammad Alam
    Jian-Feng Wang
    Cong Guangpei
    LV Yunrong
    Yuanfang Chen
    Mobile Networks and Applications, 2021, 26 : 200 - 215