A Generative Modelling Technique for 3D Reconstruction from a Single 2D Image

被引:0
|
作者
Singh, Saurabh Kumar [1 ]
Tanna, Shrey [1 ]
机构
[1] IIT BHU, Dept Comp Sci & Engn, Varanasi, Uttar Pradesh, India
关键词
Reconstruction; GANs; CNNs; Neural networks; Voxel;
D O I
10.1109/iemtronics51293.2020.9216389
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
3D Object Reconstruction is the task of predicting the 3D model of an object given a set of 2D images. In this paper, we propose an approach to solving this problem, given a single 2D image. We attempt to make use of several deep learning techniques. Our model consists of two parts. The first part generates multiple images having different viewpoints. We have included this part because reconstructing 3D object directly from a single 2D image is quite difficult, but the same task would be a lot easier given multiple images which capture different views of that same object. Also, predicting an image having a different viewpoint is much easier than predicting the whole 3D object, given an input image. The second part uses a network consisting of an Encoder, a Decoder (or Generator), and a Discriminator to predict the complete 3D voxel grid of the object. In this way, we achieve significant improvements in the results as compared to the existing techniques.
引用
收藏
页码:297 / 301
页数:5
相关论文
共 50 条
  • [41] Generation of 3D image sequences from mixed 2D and 3D image sources
    Börcsök, J
    [J]. WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL XVII, PROCEEDINGS: CYBERNETICS AND INFORMATICS: CONCEPTS AND APPLICATIONS (PT II), 2001, : 386 - 388
  • [42] 3D Reconstruction of 2D Crystals
    Zeng, Xiangyan
    Glover, James Ervin
    Hughes, Owen
    Stahlberg, Henning
    [J]. PROCEEDINGS OF THE 49TH ANNUAL ASSOCIATION FOR COMPUTING MACHINERY SOUTHEAST CONFERENCE (ACMSE '11), 2011, : 160 - 165
  • [43] 3D reconstruction for 2D PET
    Erlandsson, K
    Strand, SE
    [J]. NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 1997, 391 (02): : 369 - 374
  • [44] A 2D image 3D reconstruction function adaptive denoising algorithm
    Wang, Feng
    Ni, Weichuan
    Liu, Shaojiang
    Xu, Zhiming
    Qiu, Zemin
    Wan, Zhiping
    [J]. PEERJ COMPUTER SCIENCE, 2023, 9
  • [45] Method Comparison of 3D Facial Reconstruction Coresponding to 2D Image
    Tjahyaningtijas, H. P. A.
    Puspitasari, P.
    Yamasari, Y.
    Anifah, L.
    Buditjahyanto, I. G. P. A.
    [J]. 2ND ANNUAL APPLIED SCIENCE AND ENGINEERING CONFERENCE (AASEC 2017), 2018, 288
  • [46] A 2D image 3D reconstruction function adaptive denoising algorithm
    Wang, Feng
    Ni, Weichuan
    Liu, Shaojiang
    Xu, Zhiming
    Qiu, Zemin
    Wan, Zhiping
    [J]. PeerJ Computer Science, 2023, 9 : 1 - 17
  • [47] Stochastic reconstruction of 3D porous media from 2D images using generative adversarial networks
    Valsecchi, Andrea
    Damas, Sergio
    Tubilleja, Cristina
    Arechalde, Javier
    [J]. NEUROCOMPUTING, 2020, 399 : 227 - 236
  • [48] Retinal image registration from 2D to 3D
    Lin, Yuping
    Medioni, Gerard
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2830 - 2837
  • [49] Computing 3D saliency from a 2D image
    Ramenahalli, Sudarshan
    Niebur, Ernst
    [J]. 2013 47TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2013,
  • [50] Image scanners: 2D and 3D
    Handley, R.
    [J]. Advanced Imaging, 2001, 16 (07) : 28 - 33