SEMANTIC SEGMENTATION OF INDOOR POINT CLOUDS USING CONVOLUTIONAL NEURAL NETWORK

被引:14
|
作者
Babacan, K. [1 ]
Chen, L. [1 ]
Sohn, G. [1 ]
机构
[1] York Univ Toronto, Dept Earth & Space Sci & Engn, N York, ON M3J 1P3, Canada
关键词
Indoor Modelling; Semantic Segmentation; Mobile Laser; Point Cloud; Deep Learning; Convolutional Neural Network; 3D RECONSTRUCTION;
D O I
10.5194/isprs-annals-IV-4-W4-101-2017
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As Building Information Modelling (BIM) thrives, geometry becomes no longer sufficient; an ever increasing variety of semantic information is needed to express an indoor model adequately. On the other hand, for the existing buildings, automatically generating semantically enriched BIM from point cloud data is in its infancy. The previous research to enhance the semantic content rely on frameworks in which some specific rules and/or features that are hand coded by specialists. These methods immanently lack generalization and easily break in different circumstances. On this account, a generalized framework is urgently needed to automatically and accurately generate semantic information. Therefore we propose to employ deep learning techniques for the semantic segmentation of point clouds into meaningful parts. More specifically, we build a volumetric data representation in order to efficiently generate the high number of training samples needed to initiate a convolutional neural network architecture. The feedforward propagation is used in such a way to perform the classification in voxel level for achieving semantic segmentation. The method is tested both for a mobile laser scanner point cloud, and a larger scale synthetically generated data. We also demonstrate a case study, in which our method can be effectively used to leverage the extraction of planar surfaces in challenging cluttered indoor environments.
引用
收藏
页码:101 / 108
页数:8
相关论文
共 50 条
  • [31] Hybrid Spiking Fully Convolutional Neural Network for Semantic Segmentation
    Zhang, Tao
    Xiang, Shuiying
    Liu, Wenzhuo
    Han, Yanan
    Guo, Xingxing
    Hao, Yue
    ELECTRONICS, 2023, 12 (17)
  • [32] Convolutional Neural Network for the Semantic Segmentation of Remote Sensing Images
    Alam, Muhammad
    Wang, Jian-Feng
    Guangpei, Cong
    Yunrong, L., V
    Chen, Yuanfang
    MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01): : 200 - 215
  • [33] Combining Deep Semantic Segmentation Network and Graph Convolutional Neural Network for Semantic Segmentation of Remote Sensing Imagery
    Ouyang, Song
    Li, Yansheng
    REMOTE SENSING, 2021, 13 (01) : 1 - 22
  • [34] Semantic Segmentation on Radar Point Clouds
    Schumann, Ole
    Hahn, Markus
    Dickmann, Juergen
    Woehler, Christian
    2018 21ST INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2018, : 2179 - 2186
  • [35] Semantic Segmentation of Bioimages Using Convolutional Neural Networks
    Wiehman, Stiaan
    de Villiers, Hendrik
    2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, : 624 - 631
  • [36] SpSequenceNet: Semantic Segmentation Network on 4D Point Clouds
    Shi, Hanyu
    Lin, Guosheng
    Wang, Hao
    Hung, Tzu-Yi
    Wang, Zhenhua
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4573 - 4582
  • [37] Fast segmentation of point clouds using a convolutional neural network for helping visually impaired people find the closest traversable region
    Tinizaray, Paul
    Naranjo, Jose Fransisco Lucio
    Aguilar, Wilbert G.
    INTELIGENCIA ARTIFICIAL-IBEROAMERICAL JOURNAL OF ARTIFICIAL INTELLIGENCE, 2022, 25 (70): : 50 - 63
  • [38] Kangaroo Vehicle Collision Detection Using Deep Semantic Segmentation Convolutional Neural Network
    Saleh, Khaled
    Hossny, Mohammed
    Nahavandi, Saeid
    2016 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2016, : 281 - 287
  • [39] Semantic Point Cloud Segmentation Using Fast Deep Neural Network and DCRF
    Rao, Yunbo
    Zhang, Menghan
    Cheng, Zhanglin
    Xue, Junmin
    Pu, Jiansu
    Wang, Zairong
    SENSORS, 2021, 21 (08)
  • [40] MULTI-SOURCE POINT CLOUD SEMANTIC SEGMENTATION USING NEURAL NETWORK
    Montlahuc, Jeremy
    Polette, Arnaud
    Tahan, Antoine
    Pernot, Jean-Philippe
    Rivest, Louis
    XXIV ISPRS CONGRESS: IMAGING TODAY, FORESEEING TOMORROW, COMMISSION III, 2022, 43-B3 : 515 - 522