3D Location and Trajectory Reconstruction of a Moving Object Behind Scattering Media

被引:7
|
作者
Deng, Rujia [1 ,2 ]
Jin, Xin [1 ]
Du, Dongyu [1 ,2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen Key Lab Broadband Network & Multimedia, Shenzhen 518055, Peoples R China
[2] Tsinghua Innovat Ctr Zhuhai, Zhuhai 519080, Peoples R China
基金
中国国家自然科学基金;
关键词
Scattering imaging; inverse problems; locating moving objects; TRACKING; TARGETS;
D O I
10.1109/TCI.2022.3170651
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Reconstructing an object's location and monitoring its movement through scattering media remains a significant challenge in applications. Existing methods suffer from the object motion limit, the prior of the object information, or the complex optical setup. Here, we focus on reconstructing the 3D location and trajectory of an object in motion behind scattering media by explicitly modeling and inverting the time-varying light transportation. A time-varying scattering imaging model is derived to encode the positions of the moving object in the intensity videos captured by a conventional RGB camera. Based on the model, we find that the object lies on 3D surfaces determined by point pairs on the scattering media. We then develop a back-projection method to build a 3D confidence map for the voxelized object space to find the voxel with the maximum confidence as the object position in the reconstructed trajectory at the corresponding video time. The effectiveness of the proposed method to locate moving self-illuminated and light-reflective objects in different shapes behind scattering media with different thicknesses using 2D intensity images is verified by simulated experiments and real scattering imaging systems. The reconstructions of multiple objects and different lighting conditions are discussed.
引用
收藏
页码:371 / 384
页数:14
相关论文
共 50 条
  • [31] 3D Trajectory Reconstruction under Perspective Projection
    Hyun Soo Park
    Takaaki Shiratori
    Iain Matthews
    Yaser Sheikh
    International Journal of Computer Vision, 2015, 115 : 115 - 135
  • [32] Object Detection and Depth Estimation for 3D Trajectory Extraction
    Boukhers, Zeyd
    Shirahama, Kimiaki
    Li, Frederic
    Grzegorzek, Marcin
    2015 13TH INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2015,
  • [33] 3D Object Reconstruction from Hand-Object Interactions
    Tzionas, Dimitrios
    Gall, Juergen
    2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 729 - 737
  • [34] 3D object digitization: Topology preserving reconstruction
    Stelldinger, Peer
    Latecki, Longin Jan
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS, 2006, : 693 - +
  • [35] 3D reconstruction method adapted to regular object
    Wang, Jia-Sheng
    Tang, Hao-Xuan
    Tong, Jian-Guo
    Su, Xiao-Hong
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2009, 41 (03): : 152 - 156
  • [36] Turntable-based 3D object reconstruction
    Fremont, V
    Chellali, R
    2004 IEEE CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS, VOLS 1 AND 2, 2004, : 1277 - 1282
  • [37] An integrated system for 3D object reconstruction and recognition
    Xing, Weiwei
    Liu, Weibin
    Yuan, Baozong
    Lu, Wei
    NEW ADVANCES IN SIMULATION, MODELLING AND OPTIMIZATION (SMO '07), 2007, : 281 - +
  • [38] Divisional 3D shape reconstruction of object image
    Xu, D
    Xia, LZ
    Yang, SZ
    VISUALIZATION AND OPTIMIZATION TECHNIQUES, 2001, 4553 : 56 - 60
  • [39] Monocular 3D Object Reconstruction with GAN Inversion
    Zhang, Junzhe
    Ren, Daxuan
    Cai, Zhongang
    Yeo, Chai Kiat
    Dai, Bo
    Loy, Chen Change
    COMPUTER VISION - ECCV 2022, PT I, 2022, 13661 : 673 - 689
  • [40] Model Sensor Device for 3D Object Reconstruction
    Daud, Siti Asmah
    Mahmood, Nasrul Humaimi
    Ling, Leow Pei
    Harun, Fauzan Khairi Che
    JURNAL TEKNOLOGI, 2015, 74 (06): : 109 - 113