Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

被引:4
|
作者
Jiang, Tengping [1 ,2 ,3 ,4 ]
Liu, Shan [1 ,2 ,3 ]
Zhang, Qinyu [1 ,2 ,3 ]
Xu, Xin [1 ,2 ,3 ]
Sun, Jian [1 ,2 ,3 ]
Wang, Yongjun [1 ,2 ,3 ]
机构
[1] Jiangsu Ctr Collaborat Innovat Geog Informat Resou, Nanjing 210023, Peoples R China
[2] Nanjing Normal Univ, Key Lab Virtual Geog Environm, Minist Educ, Nanjing 210093, Peoples R China
[3] State Key Lab Cultivat Base Geog Environm Evolut, Nanjing 210093, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
Mobile laser scanning (MLS) point clouds; Individual tree segmentation; Instance segmentation; Cylindrical voxel representation; Cylinder convolution; EXTRACTION;
D O I
10.1016/j.jag.2023.103473
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Automatic and accurate instance segmentation of street trees from point clouds is a fundamental task in urban green space research. Previous studies have achieved satisfactory tree segmentation results in simple scenarios. However, for challenging cases, including adjacent overlapping tree crowns, irregular tree shapes, and incompleteness caused by occlusion, most methods show under- or over-segmentation effects. In this study, an automated two-stage framework (tree extraction and individual tree segmentation) using vehicle-mounted mobile laser scanning (MLS) point clouds is developed to robustly detect single roadside trees. In the first stage, the ground points are filtered to reduce the processing time. Subsequently, an improved graph-based semantic segmentation network extracts roadside tree points from the urban scenes. For individual tree segmentation, a segmentation strategy combining cylindrical convolution and dynamic shift detects instance-level roadside trees. A simple road environment and two complex urban areas are used to verify the performance of the individual urban tree segmentation. The proposed method achieves 84-92% overall segmentation accuracy of the roadside tree point clouds and significantly outperforms existing methods in various challenging cases. Some applications can benefit from individual tree segmentation. For instance, the 3D green volume is calculated at the level of individual urban trees. The proposed method provides a practical solution for ecological assessment based on the 3D green volume of urban roads.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] A point-based deep learning network for semantic segmentation of MLS point clouds
    Han, Xu
    Dong, Zhen
    Yang, Bisheng
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 175 : 199 - 214
  • [2] Road-Side Individual Tree Segmentation from Urban MLS Point Clouds Using Metric Learning
    Wang, Pengcheng
    Tang, Yong
    Liao, Zefan
    Yan, Yao
    Dai, Lei
    Liu, Shan
    Jiang, Tengping
    [J]. REMOTE SENSING, 2023, 15 (08)
  • [3] Detection of Individual Trees in UAV LiDAR Point Clouds Using a Deep Learning Framework Based on Multichannel Representation
    Luo, Zhipeng
    Zhang, Ziyue
    Li, Wen
    Chen, Yiping
    Wang, Cheng
    Nurunnabi, Abdul Awal Md
    Li, Jonathan
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] A Dense Feature Pyramid Network-Based Deep Learning Model for Road Marking Instance Segmentation Using MLS Point Clouds
    Chen, Siyun
    Zhang, Zhenxin
    Zhong, Ruofei
    Zhang, Liqiang
    Ma, Hao
    Liu, Lirong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (01): : 784 - 800
  • [5] A Multi-task Learning Framework for Semantic Segmentation in MLS Point Clouds
    Lin, Xi
    Luo, Huan
    Guo, Wenzhong
    Wang, Cheng
    Li, Jonathan
    [J]. ARTIFICIAL INTELLIGENCE AND SECURITY, ICAIS 2022, PT I, 2022, 13338 : 382 - 392
  • [6] Instance Segmentation of Trees in Urban Areas from MLS Point Clouds Using Supervoxel Contexts and Graph-based Optimization
    Xu, Yusheng
    Sun, Zhenghao
    Hoegner, Ludwig
    Stilla, Uwe
    Yao, Wei
    [J]. 2018 10TH IAPR WORKSHOP ON PATTERN RECOGNITION IN REMOTE SENSING (PRRS), 2018,
  • [7] Change Detection of Urban Trees in MLS Point Clouds Using Occupancy Grids
    Hirt, Philipp-Roman
    Xu, Yusheng
    Hoegner, Ludwig
    Stilla, Uwe
    [J]. PFG-JOURNAL OF PHOTOGRAMMETRY REMOTE SENSING AND GEOINFORMATION SCIENCE, 2021, 89 (04): : 301 - 318
  • [8] Change Detection of Urban Trees in MLS Point Clouds Using Occupancy Grids
    Philipp-Roman Hirt
    Yusheng Xu
    Ludwig Hoegner
    Uwe Stilla
    [J]. PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 2021, 89 : 301 - 318
  • [9] SEMANTIC URBAN MESH SEGMENTATION BASED ON AERIAL OBLIQUE IMAGES AND POINT CLOUDS USING DEEP LEARNING
    Wilk, L.
    Mielczarek, D.
    Ostrowski, W.
    Dominik, W.
    Krawczyk, J.
    [J]. XXIV ISPRS CONGRESS IMAGING TODAY, FORESEEING TOMORROW, COMMISSION II, 2022, 43-B2 : 485 - 491
  • [10] A Cylindrical Convolution Network for Dense Top-View Semantic Segmentation with LiDAR Point Clouds
    Lu, Jiacheng
    Gu, Shuo
    Xu, Cheng-Zhong
    Kong, Hui
    [J]. COMPUTER VISION - ACCV 2022, PT VII, 2023, 13847 : 344 - 360