Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

被引:4
|
作者
Jiang, Tengping [1 ,2 ,3 ,4 ]
Liu, Shan [1 ,2 ,3 ]
Zhang, Qinyu [1 ,2 ,3 ]
Xu, Xin [1 ,2 ,3 ]
Sun, Jian [1 ,2 ,3 ]
Wang, Yongjun [1 ,2 ,3 ]
机构
[1] Jiangsu Ctr Collaborat Innovat Geog Informat Resou, Nanjing 210023, Peoples R China
[2] Nanjing Normal Univ, Key Lab Virtual Geog Environm, Minist Educ, Nanjing 210093, Peoples R China
[3] State Key Lab Cultivat Base Geog Environm Evolut, Nanjing 210093, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
Mobile laser scanning (MLS) point clouds; Individual tree segmentation; Instance segmentation; Cylindrical voxel representation; Cylinder convolution; EXTRACTION;
D O I
10.1016/j.jag.2023.103473
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Automatic and accurate instance segmentation of street trees from point clouds is a fundamental task in urban green space research. Previous studies have achieved satisfactory tree segmentation results in simple scenarios. However, for challenging cases, including adjacent overlapping tree crowns, irregular tree shapes, and incompleteness caused by occlusion, most methods show under- or over-segmentation effects. In this study, an automated two-stage framework (tree extraction and individual tree segmentation) using vehicle-mounted mobile laser scanning (MLS) point clouds is developed to robustly detect single roadside trees. In the first stage, the ground points are filtered to reduce the processing time. Subsequently, an improved graph-based semantic segmentation network extracts roadside tree points from the urban scenes. For individual tree segmentation, a segmentation strategy combining cylindrical convolution and dynamic shift detects instance-level roadside trees. A simple road environment and two complex urban areas are used to verify the performance of the individual urban tree segmentation. The proposed method achieves 84-92% overall segmentation accuracy of the roadside tree point clouds and significantly outperforms existing methods in various challenging cases. Some applications can benefit from individual tree segmentation. For instance, the 3D green volume is calculated at the level of individual urban trees. The proposed method provides a practical solution for ecological assessment based on the 3D green volume of urban roads.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Deep Learning Based Sentiment Analysis Using Convolution Neural Network
    Sujata Rani
    Parteek Kumar
    [J]. Arabian Journal for Science and Engineering, 2019, 44 : 3305 - 3314
  • [32] Individual nursery trees classification and segmentation using a point cloud-based neural network with dense connection pattern
    Xu, Jie
    Liu, Hui
    Shen, Yue
    Zeng, Xiao
    Zheng, Xinpeng
    [J]. SCIENTIA HORTICULTURAE, 2024, 328
  • [33] Semantic segmentation of point clouds of building interiors with deep learning: Augmenting training datasets with synthetic BIM-based point clouds
    Won, Jong
    Czerniawski, Thomas
    Leite, Fernanda
    [J]. AUTOMATION IN CONSTRUCTION, 2020, 113
  • [34] Improved deep learning segmentation of outdoor point clouds with different sampling strategies and using intensities
    Harintaka, Harintaka
    Wijaya, Calvin
    [J]. OPEN GEOSCIENCES, 2024, 16 (01):
  • [35] Dual attention-based deep learning network for multi-class object semantic segmentation of tunnel point clouds
    Ji, Ankang
    Zhang, Limao
    Fan, Hongqin
    Xue, Xiaolong
    Dou, Yudan
    [J]. AUTOMATION IN CONSTRUCTION, 2023, 156
  • [36] Advancements in Semantic Segmentation Methods for Large-Scale Point Clouds Based on Deep Learning
    Ai Da
    Zhang Xiaoyang
    Xu Ce
    Qin Siyu
    Yuan Hui
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (12)
  • [37] A Survey on Deep Learning Based Segmentation, Detection and Classification for 3D Point Clouds
    Vinodkumar, Prasoon Kumar
    Karabulut, Dogus
    Avots, Egils
    Ozcinar, Cagri
    Anbarjafari, Gholamreza
    [J]. ENTROPY, 2023, 25 (04)
  • [38] Deep Learning Based Underwater Image Enhancement Using Deep Convolution Neural Network
    Ray, Sharmita
    Baghel, Amit
    Bhatia, Vimal
    [J]. 2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [39] A Classification-Segmentation Framework for the Detection of Individual Trees in Dense MMS Point Cloud Data Acquired in Urban Areas
    Weinmann, Martin
    Weinmann, Michael
    Mallet, Clement
    Bredif, Mathieu
    [J]. REMOTE SENSING, 2017, 9 (03)