Error Model and Concise Temporal Network for Indirect Illumination in 3D Reconstruction

被引:0
|
作者
Chen, Yuchong [1 ,2 ]
Yao, Pengcheng [3 ]
Gao, Rui [1 ,2 ]
Zhang, Wei [1 ,2 ]
Gai, Shaoyan [1 ,2 ]
Yu, Jian [1 ,2 ]
Da, Feipeng [1 ,2 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
[2] Southeast Univ, Key Lab Measurement & Control Complex Syst Engn, Minist Educ, Nanjing 210096, Peoples R China
[3] Fuyang Normal Univ, Sch Comp & Informat Engn, Fuyang 236041, Peoples R China
基金
中国国家自然科学基金;
关键词
3D measurement; phase shifting profilometry; indirect illumination; subsurface scattering; phase image; FRINGE PROJECTION PROFILOMETRY; TRANSLUCENT OBJECTS; SHAPE MEASUREMENT;
D O I
10.1109/TIP.2024.3472502
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D reconstruction is a fundamental task in robotics and AI, providing a prerequisite for many related applications. Fringe projection profilometry is an efficient and non-contact method for generating 3D point clouds out of 2D images. However, during the actual measurement, it is inevitable to experiment with translucent objects, such as skin, marble, and fruit. Indirect illumination from these objects has substantially compromised the precision of 3D reconstruction via the contamination of 2D images. This paper presents a fast and accurate approach to correct for indirect illumination. The essential idea is to design a highly suitable network architecture founded on a precise error model that facilitates accurate error rectification. Initially, our method transforms the error generated by indirect illumination into a sine series. Based on this error model, the multilayer perceptron is more effective in error correction than traditional methods and convolutional neural networks. Our network was trained solely on simulated data but was tested on authentic images. Three sets of experiments, including two sets of comparison experiments, indicate that the designed network can efficiently rectify the error induced by indirect illumination.
引用
收藏
页码:5849 / 5863
页数:15
相关论文
共 50 条
  • [41] Illumination control in view of dynamic (re)planning of 3D reconstruction tasks
    Belhaoua, Abdelkrim
    Kohler, Sophie
    Hirsch, Ernest
    TENTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2011, 8000
  • [42] Illumination invariant recognition and 3D reconstruction of faces using desktop optics
    Mian, Ajmal
    OPTICS EXPRESS, 2011, 19 (08): : 7491 - 7506
  • [43] The Reconstruction of Three-Dimensional (3D) Model of The Right Parietal-Temporal Implant
    Dagang, Wan Nur Fatini Syahirah W.
    Mahmud, Jamaluddin
    Manan, Nor Fazli Adull
    Abdullah, Abdul Halim
    5TH BIOMEDICAL ENGINEERINGS RECENT PROGRESS IN BIOMATERIALS, DRUGS DEVELOPMENT, AND MEDICAL DEVICES, 2021, 2344
  • [44] Neural network based 3D model reconstruction with highly distorted stereoscopic sensors
    Wang, WL
    Xia, BB
    Guan, Q
    Chen, SY
    COMPUTATIONAL INTELLIGENCE AND BIOINSPIRED SYSTEMS, PROCEEDINGS, 2005, 3512 : 661 - 668
  • [45] 3D reconstruction technology of SMT solder joint by shape from shading based on improved illumination model
    Zhao, Huihuang
    Zhou, Dejian
    Huang, Chunyue
    Hanjie Xuebao/Transactions of the China Welding Institution, 2009, 30 (11): : 77 - 80
  • [46] Error Accuracy Estimation of 3D Reconstruction and 3D Camera Pose from RGB-D Data
    Ortiz-Fernandez, Luis E.
    Silva, Bruno M. F.
    Goncalves, Luiz M. G.
    2022 35TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2022), 2022, : 67 - 72
  • [47] Concise and Effective Network for 3D Human Modeling From Orthogonal Silhouettes
    Liu, Bin
    Liu, Xiuping
    Yang, Zhixin
    Wang, Charlie C. L.
    JOURNAL OF COMPUTING AND INFORMATION SCIENCE IN ENGINEERING, 2022, 22 (05)
  • [48] Line Laser 3D Scene Reconstruction System and Error Analysis
    Zhan Kunfeng
    Chen Wenjian
    Li Wuseng
    Zhang Lu
    CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2018, 45 (12):
  • [49] 3D image reconstruction of architectural model based on 3D printing technology
    Hu, Ting
    Wang, Wei
    INTELLIGENT BUILDINGS INTERNATIONAL, 2023,
  • [50] Error Evaluation in a Stereovision-Based 3D Reconstruction System
    Abdelkrim Belhaoua
    Sophie Kohler
    Ernest Hirsch
    EURASIP Journal on Image and Video Processing, 2010