Error Model and Concise Temporal Network for Indirect Illumination in 3D Reconstruction

被引:0
|
作者
Chen, Yuchong [1 ,2 ]
Yao, Pengcheng [3 ]
Gao, Rui [1 ,2 ]
Zhang, Wei [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Fuyang Normal Univ, Sch Comp & Informat Engn, Fuyang 236041, Peoples R China
基金
中国国家自然科学基金;
关键词
3D measurement; phase shifting profilometry; indirect illumination; subsurface scattering; phase image; FRINGE PROJECTION PROFILOMETRY; TRANSLUCENT OBJECTS; SHAPE MEASUREMENT;
D O I
10.1109/TIP.2024.3472502
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction is a fundamental task in robotics and AI, providing a prerequisite for many related applications. Fringe projection profilometry is an efficient and non-contact method for generating 3D point clouds out of 2D images. However, during the actual measurement, it is inevitable to experiment with translucent objects, such as skin, marble, and fruit. Indirect illumination from these objects has substantially compromised the precision of 3D reconstruction via the contamination of 2D images. This paper presents a fast and accurate approach to correct for indirect illumination. The essential idea is to design a highly suitable network architecture founded on a precise error model that facilitates accurate error rectification. Initially, our method transforms the error generated by indirect illumination into a sine series. Based on this error model, the multilayer perceptron is more effective in error correction than traditional methods and convolutional neural networks. Our network was trained solely on simulated data but was tested on authentic images. Three sets of experiments, including two sets of comparison experiments, indicate that the designed network can efficiently rectify the error induced by indirect illumination.
引用
收藏
页码:5849 / 5863
页数:15
相关论文
共 50 条
  • [31] SSRNet: Scalable 3D Surface Reconstruction Network
    Mi, Zhenxing
    Luo, Yiming
    Tao, Wenbing
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 967 - 976
  • [32] Spatio-Temporal Reconstruction for 3D Motion Recovery
    Yang, Jingyu
    Guo, Xin
    Li, Kun
    Wang, Meiyuan
    Lai, Yu-Kun
    Wu, Feng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (06) : 1583 - 1596
  • [33] Proposal for spatial and temporal comparison in the algorithms for 3D reconstruction
    Alvarez-Cedillo, Jesus-Antonio
    Martinez-Pinon, Fernando
    Sandoval-Gutierrez, Jacobo
    Aguilar-Fernandez, Mario
    Alvarez-Sanchez, Teodoro
    DYNA, 2021, 96 (03): : 237 - 237
  • [34] SSRNet: Scalable 3D Surface Reconstruction Network
    Yuan, Ganzhangqin
    Fu, Qiancheng
    Mi, Zhenxing
    Luo, Yiming
    Tao, Wenbing
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (12) : 4906 - 4919
  • [35] Binocular 3D reconstruction based on neural network
    Lin, MX
    Zhao, YR
    Guan, ZG
    Ding, FH
    Xu, QX
    Wang, XH
    ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 2, PROCEEDINGS, 2005, 3497 : 765 - 771
  • [36] 3D reconstruction approach based on neural network
    Hu, Haifeng
    Yang, Zhi
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 2, PROCEEDINGS, 2007, 4492 : 630 - +
  • [37] From 2D to 3D: Using illumination cones to build 3d face model
    Xiao, S. S.
    Jin, M.
    4TH INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION SCIENCE AND TECHNOLOGY (ISIST' 2006), 2006, 48 : 318 - 323
  • [38] Fusing Multiview and Photometric Stereo for 3D Reconstruction under Uncalibrated Illumination
    Wu, Chenglei
    Liu, Yebin
    Dai, Qionghai
    Wilburn, Bennett
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2011, 17 (08) : 1082 - 1095
  • [39] USING FACIAL SYMMETRY IN THE ILLUMINATION CONE BASED 3D FACE RECONSTRUCTION
    Chen, Jiansheng
    Xia, Cong
    Ying, Han
    Yang, Chang
    Su, Guangda
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 3700 - 3704
  • [40] Texture and illumination preserving 3d face reconstruction based on face normalization
    Yang Y.
    Wu X.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2019, 32 (06): : 557 - 568