Error Model and Concise Temporal Network for Indirect Illumination in 3D Reconstruction

被引:0
|
作者
Chen, Yuchong [1 ,2 ]
Yao, Pengcheng [3 ]
Gao, Rui [1 ,2 ]
Zhang, Wei [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Fuyang Normal Univ, Sch Comp & Informat Engn, Fuyang 236041, Peoples R China
基金
中国国家自然科学基金;
关键词
3D measurement; phase shifting profilometry; indirect illumination; subsurface scattering; phase image; FRINGE PROJECTION PROFILOMETRY; TRANSLUCENT OBJECTS; SHAPE MEASUREMENT;
D O I
10.1109/TIP.2024.3472502
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction is a fundamental task in robotics and AI, providing a prerequisite for many related applications. Fringe projection profilometry is an efficient and non-contact method for generating 3D point clouds out of 2D images. However, during the actual measurement, it is inevitable to experiment with translucent objects, such as skin, marble, and fruit. Indirect illumination from these objects has substantially compromised the precision of 3D reconstruction via the contamination of 2D images. This paper presents a fast and accurate approach to correct for indirect illumination. The essential idea is to design a highly suitable network architecture founded on a precise error model that facilitates accurate error rectification. Initially, our method transforms the error generated by indirect illumination into a sine series. Based on this error model, the multilayer perceptron is more effective in error correction than traditional methods and convolutional neural networks. Our network was trained solely on simulated data but was tested on authentic images. Three sets of experiments, including two sets of comparison experiments, indicate that the designed network can efficiently rectify the error induced by indirect illumination.
引用
收藏
页码:5849 / 5863
页数:15
相关论文
共 50 条
  • [11] Binary spatio-temporal encoded illumination for 3D imaging
    Li, Yong
    Chen, Yunfu
    Jin, Hongzhen
    Wang, Hui
    Guangxue Xuebao/Acta Optica Sinica, 2009, 29 (03): : 670 - 675
  • [12] 3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network
    Li, Haisheng
    Zheng, Yanping
    Wu, Xiaoqun
    Cai, Qiang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2019, 12 (02) : 697 - 705
  • [13] Urban 3D Structure Reconstruction Through a Generative Adversarial Network Model
    Bharath Haridas Aithal
    Soumya Kanta Das
    Prakash Pilinja Subrahmanya
    Arabian Journal for Science and Engineering, 2020, 45 : 10731 - 10741
  • [14] 3D Model Generation and Reconstruction Using Conditional Generative Adversarial Network
    Haisheng Li
    Yanping Zheng
    Xiaoqun Wu
    Qiang Cai
    International Journal of Computational Intelligence Systems, 2019, 12 : 697 - 705
  • [15] Urban 3D Structure Reconstruction Through a Generative Adversarial Network Model
    Aithal, Bharath Haridas
    Das, Soumya Kanta
    Subrahmanya, Prakash Pilinja
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2020, 45 (12) : 10731 - 10741
  • [16] Error Model of Misalignment Error in a Radial 3D Scanner
    Mathur, Neha
    Summan, Rahul
    Dobie, Gordon
    West, Graeme
    Marshall, Stephen
    2017 IEEE SENSORS, 2017, : 1023 - 1025
  • [17] Research on 3D Reconstruction of Flatness Error Measurement System
    Zou, Chun Long
    Wang, Sheng Huai
    Huang, Hao
    Chen, Yu Rong
    RESEARCH IN MECHANICAL ENGINEERING AND MATERIAL SCIENCE, 2014, 456 : 203 - +
  • [18] Novel Representations, Techniques and Error Evaluation for 3D Reconstruction
    Varier, Sidharth R.
    Vaidya, Amey
    Venkatesh, K. S.
    ARTICULATED MOTION AND DEFORMABLE OBJECTS, PROCEEDINGS, 2010, 6169 : 148 - 161
  • [19] Error estimation in reconstruction of quadratic curves in 3D space
    Sukavanam, N.
    Balasubramanian, R.
    Kumar, Sanjeev
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 2007, 84 (01) : 121 - 132
  • [20] Reconstruction error in 3D ultrasound imaging with mechanical probes
    Cao, Ji
    Karaday, Kerem
    Managuli, Ravi
    Kim, Yongmin
    MEDICAL IMAGING 2010: ULTRASONIC IMAGING, TOMOGRAPHY, AND THERAPY, 2010, 7629