Single image 3D object reconstruction based on deep learning: A review

被引:0
|
作者
Fu, Kui [1 ]
Peng, Jiansheng [1 ,2 ]
He, Qiwen [1 ]
Zhang, Hanxiao [2 ]
机构
[1] Hechi Univ, Sch Phys & Mech & Elect Engn, Yizhou 546300, Guangxi, Peoples R China
[2] Guangxi Univ Sci & Technol, Sch Elect & Informat Engn, Liuzhou 545006, Guangxi, Peoples R China
关键词
Single image 3D reconstruction; Deep learning; Computer vision; 3D shape representation; SHAPE RECONSTRUCTION; FACE RECONSTRUCTION; STEREO;
D O I
10.1007/s11042-020-09722-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reconstruction of 3D object from a single image is an important task in the field of computer vision. In recent years, 3D reconstruction of single image using deep learning technology has achieved remarkable results. Traditional methods to reconstruct 3D object from a single image require prior knowledge and assumptions, and the reconstruction object is limited to a certain category or it is difficult to accomplish a good reconstruction from a real image. Although deep learning can solve these problems well with its own powerful learning ability, it also faces many problems. In this paper, we first discuss the challenges faced by applying the deep learning method to reconstruct 3D objects from a single image. Second, we comprehensively review encoders, decoders and training details used in 3D reconstruction of a single image. Then, the common datasets and evaluation metrics of single image 3D object reconstruction in recent years are introduced. In order to analyze the advantages and disadvantages of different 3D reconstruction methods, a series of experiments are used for comparison. In addition, we simply give some related application examples involving 3D reconstruction of a single image. Finally, we summarize this paper and discuss the future directions.
引用
收藏
页码:463 / 498
页数:36
相关论文
共 50 条
  • [31] 3D RECONSTRUCTION BASED ON GAT FROM A SINGLE IMAGE
    Yang Dongsheng
    Kuang Ping
    Gu Xiaofeng
    [J]. 2020 17TH INTERNATIONAL COMPUTER CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (ICCWAMTIP), 2020, : 122 - 125
  • [32] 3D RECONSTRUCTION BASED ON SINGLE DEFOCUSED MICROSCOPIC IMAGE
    Xing, Z. G.
    Wei, J.
    Zhao, C. M.
    Wei, Z.
    [J]. INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION - 2012, VOL 10, 2013, : 31 - 34
  • [33] 3D Object Reconstruction from a Single Depth View with Adversarial Learning
    Yang, Bo
    Wen, Hongkai
    Wang, Sen
    Clark, Ronald
    Markham, Andrew
    Trigoni, Niki
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 679 - 688
  • [34] Divisional 3D shape reconstruction of object image
    Xu, D
    Xia, LZ
    Yang, SZ
    [J]. VISUALIZATION AND OPTIMIZATION TECHNIQUES, 2001, 4553 : 56 - 60
  • [35] Deep Learning for 3D Reconstruction, Augmentation, and Registration: A Review Paper
    Vinodkumar, Prasoon Kumar
    Karabulut, Dogus
    Avots, Egils
    Ozcinar, Cagri
    Anbarjafari, Gholamreza
    [J]. ENTROPY, 2024, 26 (03)
  • [36] Review of multi-view 3D object recognition methods based on deep learning
    Qi, Shaohua
    Ning, Xin
    Yang, Guowei
    Zhang, Liping
    Long, Peng
    Cai, Weiwei
    Li, Weijun
    [J]. DISPLAYS, 2021, 69
  • [37] Review of Single-Image 3D Face Reconstruction Methods
    Wang, Jingting
    Li, Huibin
    [J]. Computer Engineering and Applications, 2023, 59 (17) : 1 - 21
  • [38] A Review of Single Image Super-Resolution Reconstruction Based on Deep Learning
    Wu J.
    Ye X.-J.
    Huang F.
    Chen L.-Q.
    Wang Z.-F.
    Liu W.-X.
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (09): : 2265 - 2294
  • [39] A review of single image super-resolution reconstruction based on deep learning
    Yu, Ming
    Shi, Jiecong
    Xue, Cuihong
    Hao, Xiaoke
    Yan, Gang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 55921 - 55962
  • [40] A review of single image super-resolution reconstruction based on deep learning
    Ming Yu
    Jiecong Shi
    Cuihong Xue
    Xiaoke Hao
    Gang Yan
    [J]. Multimedia Tools and Applications, 2024, 83 : 55921 - 55962