Single image 3D object reconstruction based on deep learning: A review

被引:0
|
作者
Fu, Kui [1 ]
Peng, Jiansheng [1 ,2 ]
He, Qiwen [1 ]
Zhang, Hanxiao [2 ]
机构
[1] Hechi Univ, Sch Phys & Mech & Elect Engn, Yizhou 546300, Guangxi, Peoples R China
[2] Guangxi Univ Sci & Technol, Sch Elect & Informat Engn, Liuzhou 545006, Guangxi, Peoples R China
关键词
Single image 3D reconstruction; Deep learning; Computer vision; 3D shape representation; SHAPE RECONSTRUCTION; FACE RECONSTRUCTION; STEREO;
D O I
10.1007/s11042-020-09722-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The reconstruction of 3D object from a single image is an important task in the field of computer vision. In recent years, 3D reconstruction of single image using deep learning technology has achieved remarkable results. Traditional methods to reconstruct 3D object from a single image require prior knowledge and assumptions, and the reconstruction object is limited to a certain category or it is difficult to accomplish a good reconstruction from a real image. Although deep learning can solve these problems well with its own powerful learning ability, it also faces many problems. In this paper, we first discuss the challenges faced by applying the deep learning method to reconstruct 3D objects from a single image. Second, we comprehensively review encoders, decoders and training details used in 3D reconstruction of a single image. Then, the common datasets and evaluation metrics of single image 3D object reconstruction in recent years are introduced. In order to analyze the advantages and disadvantages of different 3D reconstruction methods, a series of experiments are used for comparison. In addition, we simply give some related application examples involving 3D reconstruction of a single image. Finally, we summarize this paper and discuss the future directions.
引用
收藏
页码:463 / 498
页数:36
相关论文
共 50 条
  • [1] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    [J]. Multimedia Tools and Applications, 2021, 80 (01): : 463 - 498
  • [2] Single image 3D object reconstruction based on deep learning: A review
    Kui Fu
    Jiansheng Peng
    Qiwen He
    Hanxiao Zhang
    [J]. Multimedia Tools and Applications, 2021, 80 : 463 - 498
  • [3] Application of Deep Learning to 3D Object Reconstruction From a Single Image
    Chen J.
    Zhang Y.-Q.
    Song P.
    Wei Y.-T.
    Wang Y.
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2019, 45 (04): : 657 - 668
  • [4] Review of single-image 3D human reconstruction based on deep learning
    Liu, Leyuan
    Sun, Jianchi
    Gao, Yunqi
    Gao, Changxin
    Chen, Jingying
    [J]. Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2024, 52 (05): : 98 - 122
  • [5] Colorful 3D Reconstruction from Single Image Based on Deep Learning
    Zhu Yuzheng
    Zhang Yaping
    Feng Qiaosheng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [6] Deep learning based object tracking for 3D microstructure reconstruction
    Ma, Boyuan
    Xu, Yuting
    Chen, Jiahao
    Puquan, Pan
    Ban, Xiaojuan
    Wang, Hao
    Xue, Weihua
    [J]. METHODS, 2022, 204 : 172 - 178
  • [7] Single Sketch Image based 3D Car Shape Reconstruction with Deep Learning and Lazy Learning
    Nozawa, Naoki
    Shum, Hubert P. H.
    Ho, Edmond S. L.
    Morishima, Shigeo
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 1: GRAPP, 2020, : 179 - 190
  • [8] 3D Face Reconstruction Based on a Single Image: A Review
    Diao, Haojie
    Jiang, Xingguo
    Fan, Yang
    Li, Ming
    Wu, Hongcheng
    [J]. IEEE ACCESS, 2024, 12 : 59450 - 59473
  • [9] Attention-based 3D Object Reconstruction from a Single Image
    Salvi, Andrey
    Gavenski, Nathan
    Pooch, Eduardo
    Tasoniero, Felipe
    Barros, Rodrigo
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [10] Single Target SAR 3D Reconstruction Based on Deep Learning
    Wang, Shihong
    Guo, Jiayi
    Zhang, Yueting
    Hu, Yuxin
    Ding, Chibiao
    Wu, Yirong
    [J]. SENSORS, 2021, 21 (03) : 1 - 20