Error Model and Concise Temporal Network for Indirect Illumination in 3D Reconstruction

被引:0
|
作者
Chen, Yuchong [1 ,2 ]
Yao, Pengcheng [3 ]
Gao, Rui [1 ,2 ]
Zhang, Wei [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Fuyang Normal Univ, Sch Comp & Informat Engn, Fuyang 236041, Peoples R China
基金
中国国家自然科学基金;
关键词
3D measurement; phase shifting profilometry; indirect illumination; subsurface scattering; phase image; FRINGE PROJECTION PROFILOMETRY; TRANSLUCENT OBJECTS; SHAPE MEASUREMENT;
D O I
10.1109/TIP.2024.3472502
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction is a fundamental task in robotics and AI, providing a prerequisite for many related applications. Fringe projection profilometry is an efficient and non-contact method for generating 3D point clouds out of 2D images. However, during the actual measurement, it is inevitable to experiment with translucent objects, such as skin, marble, and fruit. Indirect illumination from these objects has substantially compromised the precision of 3D reconstruction via the contamination of 2D images. This paper presents a fast and accurate approach to correct for indirect illumination. The essential idea is to design a highly suitable network architecture founded on a precise error model that facilitates accurate error rectification. Initially, our method transforms the error generated by indirect illumination into a sine series. Based on this error model, the multilayer perceptron is more effective in error correction than traditional methods and convolutional neural networks. Our network was trained solely on simulated data but was tested on authentic images. Three sets of experiments, including two sets of comparison experiments, indicate that the designed network can efficiently rectify the error induced by indirect illumination.
引用
收藏
页码:5849 / 5863
页数:15
相关论文
共 50 条
  • [1] ACCURACY OF 3D RECONSTRUCTION IN AN ILLUMINATION DOME
    MacDonald, Lindsay
    Toschi, Isabella
    Nocerino, Erica
    Hess, Mona
    Remondino, Fabio
    Robson, Stuart
    XXIII ISPRS Congress, Commission V, 2016, 41 (B5): : 69 - 76
  • [2] A CONCISE SURVEY FOR 3D RECONSTRUCTION OF BUILDING FACADES
    Klavdianos, P.
    Zhang, Q.
    Izquierdo, E.
    2013 14TH INTERNATIONAL WORKSHOP ON IMAGE ANALYSIS FOR MULTIMEDIA INTERACTIVE SERVICES (WIAMIS), 2013,
  • [3] Error estimation of 3D reconstruction in 3D digital image correlation
    Zhu, Chengpeng
    Yu, Shanshan
    Liu, Cong
    Jiang, Pengfei
    Shao, Xinxing
    He, Xiaoyuan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2019, 30 (02)
  • [4] 3D reconstruction as a network service
    Ansoldi, S
    Buora, GB
    Roberto, V
    CAMP 2005: Seventh International Workshop on Computer Architecture for Machine Perception , Proceedings, 2005, : 294 - 299
  • [5] Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors
    Heide, Felix
    Xiao, Lei
    Heidrich, Wolfgang
    Hullin, Matthias B.
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 3222 - 3229
  • [6] Model of vessels for 3D reconstruction
    León, LA
    Rodríguez, KB
    Hernández, CC
    Monreal, JE
    Pérez, JS
    METMBS'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON MATHEMATICS AND ENGINEERING TECHNIQUES IN MEDICINE AND BIOLOGICAL SCIENCES, 2003, : 410 - 416
  • [7] Error Metric Model for 3D Point Cloud Reconstruction Based on Binocular Vision
    Bian, Yuxia
    Liu, Xuejun
    Zhang, Xingguo
    2017 10TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI), 2017,
  • [8] 3D Moving Object Reconstruction by Temporal Accumulation
    Abuzaina, Anas
    Nixon, Mark S.
    Carter, John N.
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2125 - 2130
  • [9] Plastination and computerized 3D reconstruction of the temporal bone
    Qiu, MG
    Zhang, SX
    Liu, ZJ
    Tan, LW
    Wang, YS
    Deng, JH
    Tang, ZS
    CLINICAL ANATOMY, 2003, 16 (04) : 300 - 303
  • [10] Illumination and dynamic display of 3D geologic model
    Li, C.F.
    Shi, M.Y.
    Wang, G.L.
    Meitiandizhi Yu Kantan/Coal Geology & Exploration, 2001, 29 (01):