Single-view 3D object reconstruction based on NFFD and graph convolution

被引:0
|
作者
Lian Y. [1 ,2 ]
Pei S. [1 ]
Hu W. [1 ]
机构
[1] Department of Computer Science and Technology, China University of Petroleum, Beijing
[2] Beijing Key Laboratory of Petroleum Data Mining, Beijing
关键词
3D reconstruction; Control points generation network; Graph convolution network; Mixed attention; NURBS-based free-form deformation;
D O I
10.37188/OPE.20223010.1189
中图分类号
学科分类号
摘要
To address the issue of inaccurate single-view three-dimensional (3D) object reconstruction results caused by complex topological objects and the absence of irregular surface details, a novel single-view 3D object reconstruction method combining non-uniform rational B-spline free deformation with a graph convolution neural network is proposed. First, a control points generation network, which introduces the connection weight policy, is used for the feature learning of two-dimensional views to obtain their control points topology. Subsequently, the NURBS basis function is used to establish the deformation relationship between the vertex contours of the point cloud model. Finally, to enhance the details, a convolutional network embedded with a mixed attention module is used to adjust the position of the deformed point cloud to reconstruct complex topological structures and irregular surfaces efficiently. Experiments on ShapeNet data show that the average values of the CD and EMD indices are 3.79 and 3.94, respectively, and that good reconstruction is achieved on the Pix3D real scene dataset. In contrast to existing single view point cloud 3D reconstruction methods, the proposed method offers a higher reconstruction accuracy of 3D objects and demonstrates higher robustness. © 2022, Science Press. All right reserved.
引用
收藏
页码:1189 / 1202
页数:13
相关论文
共 33 条
  • [1] JIN Y W, JIANG D Q, CAI M., 3D reconstruction using deep learning: a survey, Communications in Information and Systems, 20, 4, pp. 389-413, (2020)
  • [2] FAHIM G, AMIN K, ZARIF S., Single-View 3D reconstruction: a Survey of deep learning methods, Computers & Graphics, 94, pp. 164-190, (2021)
  • [3] HENDERSON P, FERRARI V., Learning single-image 3D reconstruction by generative modelling of shape, pose and shading, International Journal of Computer Vision, 128, 4, pp. 835-854, (2020)
  • [4] CHOY C B, XU D F, GWAK J, Et al., 3D-R2N2: A unified approach for single and multi-view 3D object reconstruction, Computer Vision - ECCV 2016, pp. 628-644, (2016)
  • [5] LI L, XU H, WU S P., Fuzzy Probability Points Reasoning for 3D Reconstruction via Deep Deterministic Policy Gradient, Acta Automatica Sinica, 48, 4, pp. 1105-1118, (2022)
  • [6] XIA Q, LI S, HAO A M, Et al., Deep learning for digital geometry processing and analysis: a review, Journal of Computer Research and Development, 56, 1, pp. 155-182, (2019)
  • [7] CHENG Q Q, SUN P Y, YANG C S, Et al., A morphing-Based 3D point cloud reconstruction framework for medical image processing, Computer Methods and Programs in Biomedicine, 193, (2020)
  • [8] JIN P, LIU S L, LIU J H, Et al., Weakly-supervised single-view dense 3D point cloud reconstruction via differentiable renderer, Chinese Journal of Mechanical Engineering, 34, (2021)
  • [9] FAN H Q, SU H, GUIBAS L., A point set generation network for 3D object reconstruction from a single image, 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2126, pp. 2463-2471, (2017)
  • [10] ZHANG S F, LIU J, LIU Y H, Et al., DIMNet: Dense implicit function network for 3D human body reconstruction, Computers & Graphics, 98, pp. 1-10, (2021)