3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [1] 3D Moving Object Reconstruction by Temporal Accumulation
    Abuzaina, Anas
    Nixon, Mark S.
    Carter, John N.
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2125 - 2130
  • [2] 3D surface reconstruction of a moving object in the presence of specular reflection
    Maki, A
    IMAGE ANALYSIS AND PROCESSING - ICIAP 2005, PROCEEDINGS, 2005, 3617 : 867 - 875
  • [3] Binocular visual tracking and grasping of a moving object with a 3D trajectory predictor
    Fuentes-Pacheco, J.
    Ruiz-Ascencio, J.
    Rendon-Mancha, J. M.
    JOURNAL OF APPLIED RESEARCH AND TECHNOLOGY, 2009, 7 (03) : 259 - 274
  • [4] Effects of Camera Location on the Reconstruction of 3D Flare Trajectory with Two Cameras
    Ozsarac, Seckin
    Yesilkaya, Muhammed
    GEOSPATIAL INFORMATICS, FUSION, AND MOTION VIDEO ANALYTICS V, 2015, 9473
  • [5] Semantic Shape and Trajectory Reconstruction for Monocular Cooperative 3D Object Detection
    Cserni, Marton
    Rovid, Andras
    IEEE ACCESS, 2024, 12 : 167153 - 167167
  • [6] 3D shape reconstruction of moving object by tracking the sparse singular points
    Ebrahimnezhad, Hossein
    Ghassemian, Hassan
    2006 IEEE WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, 2006, : 192 - +
  • [7] 3D Reconstruction of Pedestrian Trajectory with Moving Direction Learning and Optimal Gait Recognition
    Wang, Binbin
    Su, Tingli
    Jin, Xuebo
    Kong, Jianlei
    Bai, Yuting
    COMPLEXITY, 2018,
  • [8] Trajectory triangulation: 3D reconstruction of moving points from a monocular image sequence
    Avidan, S
    Shashua, A
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (04) : 348 - 357
  • [9] Automated Reconstruction of 3D Object
    Ravas, Rudolf
    Syrova, Livia
    PROCEEDINGS OF 13TH INTERNATIONAL SYMPOSIUM ON MECHATRONICS, 2010, : 31 - 33
  • [10] 3D Measurement of a Moving Object Using 3D Accelerometer Attached to Moving Camera
    Akamatsu, Toshihiro
    Dong, Fangyan
    Hirota, Kaoru
    2013 IEEE 8TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING (WISP), 2013, : 71 - 76