3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [21] Exploiting Object Similarity in 3D Reconstruction
    Zhou, Chen
    Gueney, Fatma
    Wang, Yizhou
    Geiger, Andreas
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2201 - 2209
  • [22] Deformable 3D Reconstruction with an Object Database
    Alcantarilla, Pablo F.
    Bartoli, Adrien
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [23] 3D Reconstruction and Object Detection for HoloLens
    Wu, Zequn
    Zhao, Tianhao
    Nguyen, Chuong
    2020 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2020,
  • [24] Analysis by Synthesis: 3D Object Recognition by Object Reconstruction
    Hejrati, Mohsen
    Ramanan, Deva
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2449 - 2456
  • [25] 3D reconstruction of the moving object with double-shooting based on phase shifting profilometry
    Zhang Q.
    Li H.
    Lv L.
    Lu S.
    Pan W.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2023, 52 (12):
  • [26] Location dependent illumination modeling for multiple-camera-based 3D object reconstruction
    Utsumi, Akira
    Yamazoe, Hirotake
    Abe, Shinji
    17TH INTERNATIONAL CONFERENCE ON ARTIFICIAL REALITY AND TELEXISTENCE, ICAT 2007, PROCEEDINGS, 2007, : 242 - 248
  • [27] 3D surface reconstruction based trajectory control for a magnetic scattering film plating robot
    Jie Liu
    Journal of Intelligent Manufacturing, 2009, 20 : 719 - 726
  • [28] 3D surface reconstruction based trajectory control for a magnetic scattering film plating robot
    Liu, Jie
    JOURNAL OF INTELLIGENT MANUFACTURING, 2009, 20 (06) : 719 - 726
  • [29] Multimodal 3D Histogram for Moving Object Detection
    Mukherjee, Dibyendu
    Saha, Ashirbani
    Wu, Q. M. Jonathan
    Jiang, Wei
    2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 2397 - 2402
  • [30] 3D Trajectory Reconstruction under Perspective Projection
    Park, Hyun Soo
    Shiratori, Takaaki
    Matthews, Iain
    Sheikh, Yaser
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (02) : 115 - 135