Visual enhancement of single-view 3D point cloud reconstruction

被引:10
|
作者
Ping, Guiju [1 ]
Esfahani, Mahdi Abolfazli [1 ]
Chen, Jiaying [1 ]
Wang, Han [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
来源
COMPUTERS & GRAPHICS-UK | 2022年 / 102卷
关键词
3D reconstruction; Single-view; Point clouds; Differentiable render;
D O I
10.1016/j.cag.2022.01.001
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
3D reconstruction from a single image is one of the core computer vision problems. Thanks to the development of deep learning, 3D reconstruction of a single image has demonstrated impressive progress in recent years. Existing researches use Chamfer distance as a loss function to guard the training of the neural network. However, the Chamfer loss will give equal weights to all points inside the 3D point clouds. It tends to sacrifice fine-grained and thin structures to avoid incurring a high loss, which will lead to visually unsatisfactory results. This paper proposes a framework that can recover a detailed three-dimensional point cloud from a single image by focusing more on boundaries (edge and corner points). Experimental results demonstrate that the proposed method outperforms existing techniques significantly, both qualitatively and quantitatively, and has fewer training parameters. (C) 2022 Published by Elsevier Ltd.
引用
收藏
页码:112 / 119
页数:8
相关论文
共 50 条
  • [1] Single-View 3D Reconstruction of Curves
    Fakih, Ali
    Wilser, Nicola
    Maillot, Yvan
    Cordier, Frederic
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 3 - 14
  • [2] Self-supervised single-view 3D point cloud reconstruction through GAN inversion
    Li, Ying
    Guo, HaoYu
    Sheng, Huankun
    [J]. JOURNAL OF SUPERCOMPUTING, 2024, 80 (14): : 21365 - 21393
  • [3] Deep Single-View 3D Object Reconstruction with Visual Hull Embedding
    Wang, Hanqing
    Yang, Jiaolong
    Liang, Wei
    Tong, Xin
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8941 - 8948
  • [4] Learning View Priors for Single-view 3D Reconstruction
    Kato, Hiroharu
    Harada, Tatsuya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9770 - 9779
  • [5] Weakly-Supervised Single-view Dense 3D Point Cloud Reconstruction via Differentiable Renderer
    Peng Jin
    Shaoli Liu
    Jianhua Liu
    Hao Huang
    Linlin Yang
    Michael Weinmann
    Reinhard Klein
    [J]. Chinese Journal of Mechanical Engineering, 2021, 34 (05) : 211 - 221
  • [6] Weakly-Supervised Single-view Dense 3D Point Cloud Reconstruction via Differentiable Renderer
    Peng Jin
    Shaoli Liu
    Jianhua Liu
    Hao Huang
    Linlin Yang
    Michael Weinmann
    Reinhard Klein
    [J]. Chinese Journal of Mechanical Engineering, 2021, 34
  • [7] Weakly-Supervised Single-view Dense 3D Point Cloud Reconstruction via Differentiable Renderer
    Jin, Peng
    Liu, Shaoli
    Liu, Jianhua
    Huang, Hao
    Yang, Linlin
    Weinmann, Michael
    Klein, Reinhard
    [J]. CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2021, 34 (01)
  • [8] 3D-ReConstnet: A Single-View 3D-Object Point Cloud Reconstruction Network
    Li, Bin
    Zhang, Yonghan
    Zhao, Bo
    Shao, Hongyao
    [J]. IEEE ACCESS, 2020, 8 : 83782 - 83790
  • [9] Photometric single-view dense 3D reconstruction in endoscopy
    Batlle, Victor M.
    Montiel, J. M. M.
    Tardos, Juan D.
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4904 - 4910
  • [10] Dynamic Domain Adaptation for Single-view 3D Reconstruction
    Yang, Cong
    Xie, Housen
    Tian, Haihong
    Yu, Yuanlong
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3563 - 3570