Learning View Priors for Single-view 3D Reconstruction

被引:40
|
作者
Kato, Hiroharu [1 ]
Harada, Tatsuya [1 ,2 ]
机构
[1] Univ Tokyo, Tokyo, Japan
[2] RIKEN, Wako, Saitama, Japan
关键词
D O I
10.1109/CVPR.2019.01001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed shapes only fit the observed views and appear incorrect from the unobserved viewpoints. To reconstruct shapes that look reasonable from any viewpoint, we propose to train a discriminator that learns prior knowledge regarding possible views. The discriminator is trained to distinguish the reconstructed views of the observed viewpoints from those of the unobserved viewpoints. The reconstructor is trained to correct unobserved views by fooling the discriminator. Our method outperforms current state-of-the-art methods on both synthetic and natural image datasets; this validates the effectiveness of our method.
引用
收藏
页码:9770 / 9779
页数:10
相关论文
共 50 条
  • [1] Learning Shape Priors for Single-View 3D Completion And Reconstruction
    Wu, Jiajun
    Zhang, Chengkai
    Zhang, Xiuming
    Zhang, Zhoutong
    Freeman, William T.
    Tenenbaum, Joshua B.
    [J]. COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 673 - 691
  • [2] Single-View 3D Object Reconstruction from Shape Priors in Memory
    Yang, Shuo
    Xu, Min
    Xie, Haozhe
    Perry, Stuart
    Xia, Jiahao
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3151 - 3160
  • [3] Single-View 3D Reconstruction of Curves
    Fakih, Ali
    Wilser, Nicola
    Maillot, Yvan
    Cordier, Frederic
    [J]. ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 3 - 14
  • [4] Fostering Generalization in Single-view 3D Reconstruction by Learning a Hierarchy of Local and Global Shape Priors
    Bechtold, Jan
    Tatarchenko, Maxim
    Fischer, Volker
    Brox, Thomas
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15875 - 15884
  • [5] Single-View 3D reconstruction: A Survey of deep learning methods
    Fahim, George
    Amin, Khalid
    Zarif, Sameh
    [J]. COMPUTERS & GRAPHICS-UK, 2021, 94 : 164 - 190
  • [6] Learning Single-View 3D Reconstruction with Limited Pose Supervision
    Yang, Guandao
    Cui, Yin
    Belongie, Serge
    Hariharan, Bharath
    [J]. COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 : 90 - 105
  • [7] Single and sparse view 3D reconstruction by learning shape priors
    Chen, Yu
    Cipolla, Roberto
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2011, 115 (05) : 586 - 602
  • [8] Semi-supervised Single-View 3D Reconstruction via Prototype Shape Priors
    Xing, Zhen
    Li, Hengduo
    Wu, Zuxuan
    Jiang, Yu-Gang
    [J]. COMPUTER VISION - ECCV 2022, PT I, 2022, 13661 : 535 - 551
  • [9] Ethnic Style Representation Learning for Single-View 3D Garment Reconstruction
    单视角三维服装重建的民族风格表征学习
    [J]. Liu, Li (ieall@kust.edu.cn), 2024, 36 (02): : 258 - 272
  • [10] Single-view 3D Reconstruction Algorithm Based on View-aware
    Wang Nian
    Hu Xuyang
    Zhu Fan
    Tang Jun
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2020, 42 (12) : 3053 - 3060