3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [41] Automatic 3D model reconstruction of the diamond object
    Zheng, Shunyi
    Zhou, Langming
    Li, Cailin
    Zhou, Yang
    MEASUREMENT, 2012, 45 (05) : 844 - 855
  • [42] Multi-stereo 3D object reconstruction
    Esteban, CH
    Schmitt, F
    FIRST INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING VISUALIZATION AND TRANSMISSION, 2002, : 159 - 166
  • [43] AutoRecon: Automated 3D Object Discovery and Reconstruction
    Wang, Yuang
    He, Xingyi
    Peng, Sida
    Lin, Haotong
    Bao, Hujun
    Zhou, Xiaowei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21382 - 21391
  • [44] 3D Object Reconstruction Using a Robot Arm
    Rossi, Cesare
    Savino, Sergio
    Strano, Salvatore
    PROCEEDINGS OF EUCOMES 08, THE SECOND EUROPEAN CONFERENCE ON MECHANISM SCIENCE, 2009, : 513 - +
  • [45] ON 3D RECONSTRUCTION OF ROTATING-OBJECT SHAPES
    ANDROSOV, AM
    VYGON, VG
    MALIKOV, SN
    TIKHONOV, EF
    OPTIKA I SPEKTROSKOPIYA, 1989, 66 (04): : 914 - 916
  • [46] Hierarchical Surface Prediction for 3D Object Reconstruction
    Bane, Christian
    Tulsiani, Shubham
    Malik, Jitendra
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 412 - 420
  • [47] Reconstruction and Verification of 3D Object Models for Grasping
    Marton, Zoltan-Csaba
    Goron, Lucian
    Rusu, Radu Bogdan
    Beetz, Michel
    ROBOTICS RESEARCH, 2011, 70 : 315 - 328
  • [48] 3D trajectory reconstruction of fast-moving objects under harsh conditions using flash radiography
    Faderl, Norbert
    ANOMALY DETECTION AND IMAGING WITH X-RAYS (ADIX) V, 2020, 11404
  • [49] EFFICIENT IMPLEMENTATION OF 3D FILTER FOR MOVING OBJECT EXTRACTION
    Chen Ken Wang Ping Wang Lunyao (Institute of Circuits and Systems
    Journal of Electronics(China), 2007, (06) : 792 - 797
  • [50] Synchronizing of moving object with novel 3D maps imaging
    Dymkova, S. S.
    Dymkov, A. D.
    2020 SYSTEMS OF SIGNAL SYNCHRONIZATION, GENERATING AND PROCESSING IN TELECOMMUNICATIONS (SYNCHROINFO), 2020,