Multi-view Based 3D Point Cloud Completion Algorithm for Vehicles

被引:2
|
作者
Ibrahim, Yahya [1 ,2 ]
Nagy, Balazs [2 ]
Benedek, Csaba [1 ,2 ]
机构
[1] Peter Pazmany Catholic Univ, Fac Informat Technol & Bion, Budapest, Hungary
[2] Inst Comp Sci & Control SZTAKI, Budapest, Hungary
关键词
D O I
10.1109/ICPR56361.2022.9956459
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D vehicle shape completion is a key task in urban environment reconstruction, since the available sensors and 3D scanning procedures (such as Mobile Laser Scanning) in an outdoor city scene cannot usually extract the entire car shapes, which can be necessary for specifying their geometric properties for further analysis or realistic visualization. In this paper, we propose a novel multi-view based 3D object point cloud completion technique. In contrast to existing approaches, our method operates on 2D images formed by projecting the point cloud from several virtual camera positions around the object of interest. Both color and geometrical information is considered during the process, generating dense textured point clouds, displaying realistic patterns in the missing regions from the partial inputs. We present both quantitative and qualitative tests on various synthetic and real laser scanned vehicle point clouds, which demonstrate that our method surpasses existing state-of-the-art approaches. By applying it to vehicles from the Shapenet dataset, our approach outperforms recent techniques in terms of Earth Mover's Distance (EMD) and Chamfer Distance (CD) by 43.8% and 12.17%, respectively.
引用
收藏
页码:2121 / 2127
页数:7
相关论文
共 50 条
  • [1] MVPointNet: Multi-View Network for 3D Object Based on Point Cloud
    Zhou, Weiguo
    Jiang, Xin
    Liu, Yun-Hui
    [J]. IEEE SENSORS JOURNAL, 2019, 19 (24) : 12145 - 12152
  • [2] Environmental Detection for Autonomous Vehicles Based on Multi-View Image and 3D LiDAR Point Cloud Map
    Fan, Yu-Cheng
    Lin, Guo-Han
    Xiao, You-Sheng
    Yan, Wei-Zhe
    [J]. IEEE ACCESS, 2023, 11 : 70408 - 70424
  • [3] Multi-view Based Clustering of 3D LiDAR Point Clouds for Intelligent Vehicles
    Jie, Haoxiang
    Ning, Zuotao
    Zhao, Qixi
    Liu, Wei
    Hu, Jun
    Gao, Jian
    [J]. AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 57 - 70
  • [4] 3D Reconstruction from multi-view point cloud Based on particle system
    Hu Wenqiang
    Qu Yi
    [J]. 2009 IITA INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS ENGINEERING, PROCEEDINGS, 2009, : 500 - +
  • [5] 3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network
    Zhang, Le
    Sun, Jian
    Zheng, Qiang
    [J]. SENSORS, 2018, 18 (11)
  • [6] Automatic registration of multi-view 3D laser point cloud based on Image Registration and Ameliorated ICP Algorithm
    Zhao Ziming
    Hao Xiangyang
    Zhao Song
    Su Yintai
    [J]. INTERNATIONAL SYMPOSIUM ON PHOTOELECTRONIC DETECTION AND IMAGING 2011: LASER SENSING AND IMAGING AND BIOLOGICAL AND MEDICAL APPLICATIONS OF PHOTONICS SENSING AND IMAGING, 2011, 8192
  • [7] Multi-view semantic learning network for point cloud based 3D object detection
    Yang, Yongguang
    Chen, Feng
    Wu, Fei
    Zeng, Deliang
    Ji, Yi-mu
    Jing, Xiao-Yuan
    [J]. NEUROCOMPUTING, 2020, 397 : 477 - 485
  • [8] 3D Shape Completion with Multi-View Consistent Inference
    Hu, Tao
    Han, Zhizhong
    Zwicker, Matthias
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 10997 - 11004
  • [9] Multi-View RGB-D Based 3D Point Cloud Face Model Reconstruction System
    Luo, Jie-Yu
    Chiu, Ching-Te
    Hsieh, An-Ting
    [J]. 2022 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS 22), 2022, : 3008 - 3012
  • [10] Toward Meta-Shape-Based Multi-View 3D Point Cloud Registration: An Evaluation
    Zhang, Shikun
    Yang, Jiaqi
    Qi, Zhaoshuai
    Zhang, Yanning
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (07) : 5361 - 5375