Error Model and Concise Temporal Network for Indirect Illumination in 3D Reconstruction

被引:0
|
作者
Chen, Yuchong [1 ,2 ]
Yao, Pengcheng [3 ]
Gao, Rui [1 ,2 ]
Zhang, Wei [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Fuyang Normal Univ, Sch Comp & Informat Engn, Fuyang 236041, Peoples R China
基金
中国国家自然科学基金;
关键词
3D measurement; phase shifting profilometry; indirect illumination; subsurface scattering; phase image; FRINGE PROJECTION PROFILOMETRY; TRANSLUCENT OBJECTS; SHAPE MEASUREMENT;
D O I
10.1109/TIP.2024.3472502
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction is a fundamental task in robotics and AI, providing a prerequisite for many related applications. Fringe projection profilometry is an efficient and non-contact method for generating 3D point clouds out of 2D images. However, during the actual measurement, it is inevitable to experiment with translucent objects, such as skin, marble, and fruit. Indirect illumination from these objects has substantially compromised the precision of 3D reconstruction via the contamination of 2D images. This paper presents a fast and accurate approach to correct for indirect illumination. The essential idea is to design a highly suitable network architecture founded on a precise error model that facilitates accurate error rectification. Initially, our method transforms the error generated by indirect illumination into a sine series. Based on this error model, the multilayer perceptron is more effective in error correction than traditional methods and convolutional neural networks. Our network was trained solely on simulated data but was tested on authentic images. Three sets of experiments, including two sets of comparison experiments, indicate that the designed network can efficiently rectify the error induced by indirect illumination.
引用
收藏
页码:5849 / 5863
页数:15
相关论文
共 50 条
  • [21] Three characterizations of 3D reconstruction uncertainty with bounded error
    Telle, B
    Stasse, O
    Yokoi, K
    Ueshiba, T
    Tomita, F
    2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-4, 2005, : 3894 - 3899
  • [22] 3D reconstruction with minimum reprojection error using PFR
    Xu, Fan
    Wang, Hongyuan
    Fang, Lei
    Tian, Wen
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2008, 36 (10): : 52 - 55
  • [23] Gated3D: Monocular 3D Object Detection From Temporal Illumination Cues
    Julca-Aguilar, Frank
    Taylor, Jason
    Bijelic, Mario
    Mannan, Fahim
    Tseng, Ethan
    Heide, Felix
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2918 - 2928
  • [24] An active volumetric model for 3D reconstruction
    Liu, X
    Yao, HX
    Chen, XL
    Gao, W
    2005 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), VOLS 1-5, 2005, : 1641 - 1644
  • [25] A Model Simplification Algorithm for 3D Reconstruction
    Liu, Zhendong
    Zhang, Chengcheng
    Cai, Haolin
    Qv, Wenhu
    Zhang, Shuaizhe
    REMOTE SENSING, 2022, 14 (17)
  • [26] Compact Model Representation for 3D Reconstruction
    Pontes, Jhony K.
    Kong, Chen
    Eriksson, Anders
    Fookes, Clinton
    Sridharan, Sridha
    Lucey, Simon
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 88 - 96
  • [27] Integration method for 3D model reconstruction
    Li, XK
    Wee, WG
    THREE-DIMENSIONAL IMAGE CAPTURE AND APPLICATIONS VI, 2004, 5302 : 125 - 135
  • [28] A Review on Process of 3D Model Reconstruction
    Intwala, Aditya M.
    Magikar, Atul
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONICS, AND OPTIMIZATION TECHNIQUES (ICEEOT), 2016, : 2851 - 2855
  • [29] Error Model and Two-Phase Correction Method for Indirect Illumination
    Chen, Yuchong
    Gai, Shaoyan
    Da, Feipeng
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [30] Occlusion Resistant Network for 3D Face Reconstruction
    Tiwari, Hitika
    Kurmi, Vinod K.
    Venkatesh, K. S.
    Chen, Yong-Sheng
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 297 - 306