3D face reconstruction based on global ICP and improved Poisson

被引:0
|
作者
Li H. [1 ]
Mei T. [1 ]
Gao Z. [2 ]
机构
[1] School of Electronic Information, Wuhan University, Wuhan
[2] School of Remote Sensing Information Engineering, Wuhan University, Wuhan
基金
中国国家自然科学基金;
关键词
face model reconstruction; point cloud depth information; point cloud registration; point cloud surface reconstruction; Poisson reconstruction;
D O I
10.11947/j.AGCS.2023.20220128
中图分类号
学科分类号
摘要
In order to realize fast and accurate 3D face digitization at low cost, a high precision and robust automatic 3D face reconstruction method is proposed in this paper. Taking the left and right face point clouds and RGB image data collected by structured light camera as input, we first propose an adaptive sub-sampling global optimization ICP(iterative closest point) registration method to integrate the left and right point clouds, and then use a improved Poisson reconstruction method through normal vector optimization to reconstruct the surface of the point cloud after registration. The Poisson reconstruction method has good reconstruction effect and reconstruction accuracy for the face point cloud, which is a non-closed point cloud. Based on generated grid model, the RBG image was mapped to the mesh model, and finally a 3D face model with detailed texture is reconstructed. Extensive face reconstruction experiments demonstrate that the proposed method has the characteristics of high robustness and high precision, and can efficiently and accurately reconstruct the 3D face. © 2023 SinoMaps Press. All rights reserved.
引用
收藏
页码:454 / 463
页数:9
相关论文
共 34 条
  • [1] YE Ricang, Three-dimensional reconstruction technique application research based on Kinect depth sensor[D], (2013)
  • [2] BAI Yunfeng, Application of Photoscan multi-view 3D reconstruction technique in soil site protection, (2017)
  • [3] ZHANG Wenyuan, LIU Xueying, WANG Fu, Application of three-dimensional reconstruction based on biomedical images[J], Journal of Chinese Practical Diagnosis and Therapy, 30, 7, pp. 629-631, (2016)
  • [4] YANG Shanmin, LIN Yi, ZHANG Jianwei, Triangular patch based texture fusion for multi-view 3D face model, Proceedings of 2018 International Conference on Graphics and Image Processing, 11069, pp. 288-298, (2019)
  • [5] MA Jieying, TIAN Xuan, ZHAI Qing, Et al., Registration of multi-view point sets based on point-to-plane measurement[J], Journal of Xi'an Jiaotong University, 56, 6, pp. 120-132, (2022)
  • [6] SHI Fengyuan, ZHENG Xunjiang, JIANG Lihui, Et al., Point cloud registration algorithm for non-cooperative targets based on Hough transform, Journal of Beijing University of Aeronautics and Astronautics, pp. 1-10
  • [7] FAHANDEZH-SAADI S, WANG Di, TOMIZUKA M., Robust feature-based point registration using directional mixture model, IFAC-PapersOnLine, 53, 2, pp. 15454-15460, (2020)
  • [8] LIU Ruohan, GUO Bingxuan, A fast surface reconstruction algorithm considering the curvature of point cloud[J], Geomatics Science and Technology, 8, 2, pp. 88-95, (2020)
  • [9] JONASSON E T, BOEUF J, MURCUTT P, Et al., Improved reconstruction of JET using LiDAR-vision fusion[J], Fusion Engineering and Design, 161, (2020)
  • [10] ZHU Ruoling, ZHANG Hao, Efficient point cloud surface reconstruction algorithm for vehicle radar based on Delaunay triangulation[J], Foreign Electronic Measurement Technology, 40, 12, pp. 44-49, (2021)