Segmentation of individual trees in urban MLS point clouds using a deep learning framework based on cylindrical convolution network

被引:4
|
作者
Jiang, Tengping [1 ,2 ,3 ,4 ]
Liu, Shan [1 ,2 ,3 ]
Zhang, Qinyu [1 ,2 ,3 ]
Xu, Xin [1 ,2 ,3 ]
Sun, Jian [1 ,2 ,3 ]
Wang, Yongjun [1 ,2 ,3 ]
机构
[1] Jiangsu Ctr Collaborat Innovat Geog Informat Resou, Nanjing 210023, Peoples R China
[2] Nanjing Normal Univ, Key Lab Virtual Geog Environm, Minist Educ, Nanjing 210093, Peoples R China
[3] State Key Lab Cultivat Base Geog Environm Evolut, Nanjing 210093, Peoples R China
[4] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430079, Peoples R China
关键词
Mobile laser scanning (MLS) point clouds; Individual tree segmentation; Instance segmentation; Cylindrical voxel representation; Cylinder convolution; EXTRACTION;
D O I
10.1016/j.jag.2023.103473
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Automatic and accurate instance segmentation of street trees from point clouds is a fundamental task in urban green space research. Previous studies have achieved satisfactory tree segmentation results in simple scenarios. However, for challenging cases, including adjacent overlapping tree crowns, irregular tree shapes, and incompleteness caused by occlusion, most methods show under- or over-segmentation effects. In this study, an automated two-stage framework (tree extraction and individual tree segmentation) using vehicle-mounted mobile laser scanning (MLS) point clouds is developed to robustly detect single roadside trees. In the first stage, the ground points are filtered to reduce the processing time. Subsequently, an improved graph-based semantic segmentation network extracts roadside tree points from the urban scenes. For individual tree segmentation, a segmentation strategy combining cylindrical convolution and dynamic shift detects instance-level roadside trees. A simple road environment and two complex urban areas are used to verify the performance of the individual urban tree segmentation. The proposed method achieves 84-92% overall segmentation accuracy of the roadside tree point clouds and significantly outperforms existing methods in various challenging cases. Some applications can benefit from individual tree segmentation. For instance, the 3D green volume is calculated at the level of individual urban trees. The proposed method provides a practical solution for ecological assessment based on the 3D green volume of urban roads.
引用
收藏
页数:19
相关论文
共 50 条
  • [21] A deep learning network for semantic labeling of large-scale urban point clouds
    Yang, Bisheng
    Han, Xu
    Dong, Zhen
    [J]. Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (08): : 1059 - 1067
  • [22] FGCN: Deep Feature-based Graph Convolutional Network for Semantic Segmentation of Urban 3D Point Clouds
    Khan, Saqib Ali
    Shi, Yilei
    Shahzad, Muhammad
    Zhu, Xiao Xiang
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 778 - 787
  • [23] 3D Semantic Segmentation of Large-Scale Point-Clouds in Urban Areas Using Deep Learning
    Lowphansirikul, Chakri
    Kim, Kyoung-Sook
    Vinayaraj, Poliyapram
    Tuarob, Suppawong
    [J]. 2019 11TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST), 2019, : 238 - 243
  • [24] Vegetation segmentation using oblique photogrammetry point clouds based on RSPT network
    Hu, Hong
    Sun, Zhangyu
    Kang, Ruihong
    Wu, Yanlan
    Wang, Baoguo
    [J]. INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2024, 17 (01)
  • [25] An Over-Segmentation-Based Uphill Clustering Method for Individual Trees Extraction in Urban Street Areas From MLS Data
    Li, Jintao
    Cheng, Xiaojun
    Wu, Zhenlun
    Guo, Wang
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 2206 - 2221
  • [26] Point Cloud Semantic Segmentation Using a Deep Learning Framework for Cultural Heritage
    Pierdicca, Roberto
    Paolanti, Marina
    Matrone, Francesca
    Martini, Massimo
    Morbidoni, Christian
    Malinverni, Eva Savina
    Frontoni, Emanuele
    Lingua, Andrea Maria
    [J]. REMOTE SENSING, 2020, 12 (06)
  • [27] Semantic Segmentation on LiDAR Point Cloud in Urban Area using Deep Learning
    Wicaksono, Satria Bagus
    Wibisono, Ari
    Jatmiko, Wisnu
    Gamal, Ahmad
    Wisesa, Hanif Arief
    [J]. 2019 4TH INTERNATIONAL WORKSHOP ON BIG DATA AND INFORMATION SECURITY (IWBIS 2019), 2019, : 63 - 66
  • [28] LWSNet: A Point-Based Segmentation Network for Leaf-Wood Separation of Individual Trees
    Jiang, Tengping
    Zhang, Qinyu
    Liu, Shan
    Liang, Chong
    Dai, Lei
    Zhang, Zequn
    Sun, Jian
    Wang, Yongjun
    [J]. FORESTS, 2023, 14 (07):
  • [29] Individual Cattle Identification Using a Deep Learning Based Framework
    Qiao, Yongliang
    Su, Daobilige
    Kong, He
    Sukkarieh, Salah
    Lomax, Sabrina
    Clark, Cameron
    [J]. IFAC PAPERSONLINE, 2019, 52 (30): : 318 - 323
  • [30] Deep Learning Based Sentiment Analysis Using Convolution Neural Network
    Rani, Sujata
    Kumar, Parteek
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2019, 44 (04) : 3305 - 3314