Semantic segmentation method of 3D scenes using dynamic graph CNN for complex city

被引:0
|
作者
Zhang R. [1 ]
Zhang G. [1 ]
Yin J. [2 ]
机构
[1] Nanjing Tech University, Nanjing
[2] Beihang University, Beijing
关键词
3D mesh; 3D real scene; 3D representation; graph CNN network; semantic segmentation;
D O I
10.11947/j.AGCS.2023.20220466
中图分类号
学科分类号
摘要
In photogrammetry and remote sensing community, 3D mesh is one of the final user products, which is widely applied in urban planning, navigation, etc. However, there are few works on semantic complex 3D mesh urban scene segmentation based on deep learning methods. Thus, a semantic segmentation method of 3D scenes using dynamic graph CNN for complex city (3Dcity-net) is proposed. By using mesh-inherent features containing 3D spatial information and texture information, a composite feature vector is proposed to represent each face in 3D mesh. To reduce the influence on semantic segmentation by the noise and redundant information in texture information, a principal component analysis (PCA) module is embedded in to the proposed 3D city-net. In order to alleviate the problem of semantic segmentation precision decrease caused by the unbalanced sample data, the focal loss function is used to replace the cross-entropy loss function. The Hessigheim 3D mesh data are utilized to perform experiments. The results of experiments show that the proposed method can obtain competitive semantic segmentation results on 3D mesh. The overall accuracy, Kappa coefficient, mean precision, mean recall, mean F1 score, and mean loll is 81.5%, 0.776, 73.0%, 58.4%, 62.6%, and 49.8%, respectively. Comparing to two state-of-the-art methods, the overall accuracy increases by 0.9%, and 8.3%, respectively. © 2023 SinoMaps Press. All rights reserved.
引用
收藏
页码:1703 / 1713
页数:10
相关论文
共 33 条
  • [1] ZHANG Guangyun, ZHANG Rongting, DAI Qionghai, Et al., The direction of integration surveying and mapping geographic information and artificial intelligence 2.0 [J], Acta Geodaetica et Cartographica Sinica, 50, 8, pp. 1096-1108, (2021)
  • [2] ZHANG Yongjun, WAN Yi, SHI Wenzhong, Et al., Technical framework and preliminary practices of photogrammetric remote sensing intelligent processing of multi-source satellite images, Acta Geodaetica et Cartographica Sinica, 50, 8, pp. 1068-1083, (2021)
  • [3] JIANG Tengping, WANG Yongjun, ZHANG Linqi, Et al., A LiDAR point cloud hierarchical semantic segmentation method combining CNN and MRF[J], Acta Geod aetica et Cartographica Sinica, 50, 2, pp. 215-225, (2021)
  • [4] HUANG Gang, Research on automatic classification method of mobile laser point cloud data based on deep learning, Acta Geodaetica et Cartographica Sinica, 51, 5, (2022)
  • [5] ZHAO Chuan, GUO Haitao, LU Jun, Et al., Roof segmentation from airborne LiDAR by combining region growing with random sample consensus, Acta Geodaetica et Cartographica Sinica, 50, 5, pp. 621-633, (2021)
  • [6] HU Xiangyun, YUAN Yi, Deep-learning-based classification for DTM extraction from ALS point cloud, Remote Sensing, 8, 9, (2016)
  • [7] RIZALDY A, PERSELLO C, GEVAERT C, Et al., Ground and multi-class classification of airborne laser scanner point clouds using fully convolutional networks, Remote Sensing, 10, 11, (2018)
  • [8] CHARLES R Q, HAO Su, MO Kaichun, Et al., PointNet: deep learning on point sets for 3D classification and segmentation, Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition, pp. 77-85, (2017)
  • [9] QI C R, YI Li, SU Hao, Et al., PointNet + +: deep hierarchical feature learning on point sets in a metric space, Proceedings of the 31st International Conference on Neural Information Processing Systems, pp. 5105-5114, (2017)
  • [10] WANG Yue, SUN Yongbin, LIU Ziwei, Et al., Dynamic graph CNN for learning on point clouds, ACM Transactions on Graphics, 38, 5