A Generative Modelling Technique for 3D Reconstruction from a Single 2D Image

被引:0
|
作者
Singh, Saurabh Kumar [1 ]
Tanna, Shrey [1 ]
机构
[1] IIT BHU, Dept Comp Sci & Engn, Varanasi, Uttar Pradesh, India
关键词
Reconstruction; GANs; CNNs; Neural networks; Voxel;
D O I
10.1109/iemtronics51293.2020.9216389
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
3D Object Reconstruction is the task of predicting the 3D model of an object given a set of 2D images. In this paper, we propose an approach to solving this problem, given a single 2D image. We attempt to make use of several deep learning techniques. Our model consists of two parts. The first part generates multiple images having different viewpoints. We have included this part because reconstructing 3D object directly from a single 2D image is quite difficult, but the same task would be a lot easier given multiple images which capture different views of that same object. Also, predicting an image having a different viewpoint is much easier than predicting the whole 3D object, given an input image. The second part uses a network consisting of an Encoder, a Decoder (or Generator), and a Discriminator to predict the complete 3D voxel grid of the object. In this way, we achieve significant improvements in the results as compared to the existing techniques.
引用
收藏
页码:297 / 301
页数:5
相关论文
共 50 条
  • [1] 3D Reconstruction of Garment from a Single 2D Image
    Liu, Hongyan
    [J]. PROCEEDINGS OF THE FIBER SOCIETY 2009 SPRING CONFERENCE, VOLS I AND II, 2009, : 1165 - 1168
  • [2] 3D Face Reconstruction from a Single 2D Face Image
    Park, Sung Won
    Heo, Jingu
    Savvides, Marios
    [J]. 2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1280 - 1287
  • [3] 3D SURFACE RECONSTRUCTION FROM A SINGLE UNCALIBRATED 2D IMAGE
    Sobani, Siti Syazalina Mohd
    Mahmood, Nasrul Humaimi
    Zakaria, Nor Aini
    [J]. JURNAL TEKNOLOGI, 2016, 78 (7-5): : 161 - 166
  • [4] 3D facial reconstruction from a single 2D rasterstereography image
    Behlim, Sadaf I.
    Syed, Tahir Q.
    [J]. 2014 4TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2014, : 303 - 307
  • [5] From 2D TO 3D through modelling based on a single image
    Gonzalez-Aguilera, Diego
    Gomez-Lahoz, Javier
    [J]. PHOTOGRAMMETRIC RECORD, 2008, 23 (122): : 208 - 227
  • [6] Automatic 3D face reconstruction based on single 2D image
    Guan, Yepeng
    [J]. MUE: 2007 INTERNATIONAL CONFERENCE ON MULTIMEDIA AND UBIQUITOUS ENGINEERING, PROCEEDINGS, 2007, : 1216 - 1219
  • [7] Cost-efficient 3D Face Reconstruction from a Single 2D Image
    Yun, Juseung
    Lee, Jaeyoung
    Han, Dongyoon
    Ju, Jeongwoo
    Kim, Junmo
    [J]. 2017 19TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATIONS TECHNOLOGY (ICACT) - OPENING NEW ERA OF SMART SOCIETY, 2017, : 629 - 632
  • [8] 3D Face Reconstruction From Single 2D Image Using Distinctive Features
    Afzal, H. M. Rehan
    Luo, Suhuai
    Afzal, M. Kamran
    Chaudhary, Gopal
    Khari, Manju
    Kumar, Sathish A. P.
    [J]. IEEE ACCESS, 2020, 8 : 180681 - 180689
  • [9] Face It: 3D Facial Reconstruction from a Single 2D Image for Games and Simulations
    Kirtzic, J. Steven
    Daescu, Ovidiu
    [J]. 2011 INTERNATIONAL CONFERENCE ON CYBERWORLDS, 2011, : 244 - 248
  • [10] 3D IMAGE RECONSTRUCTION FROM 2D CT SLICES
    Kamencay, Patrik
    Zachariasova, Martina
    Hudec, Robert
    Benco, Miroslav
    Radil, Roman
    [J]. 2014 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2014,