Non-line-of-sight Reconstruction Using Efficient Transient Rendering

被引:33
|
作者
Iseringhausen, Julian [1 ]
Hullin, Matthias B. [1 ]
机构
[1] Univ Bonn, Inst Comp Sci 2, D-53115 Bonn, Germany
来源
ACM TRANSACTIONS ON GRAPHICS | 2020年 / 39卷 / 01期
基金
欧洲研究理事会;
关键词
Non-line-of-sight sensing; looking around corners;
D O I
10.1145/3368314
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Being able to see beyond the direct line of sight is an intriguing prospect and could benefit a wide variety of important applications. Recent work has demonstrated that time-resolved measurements of indirect diffuse light contain valuable information for reconstructing shape and reflectance properties of objects located around a corner. In this article, we introduce a novel reconstruction scheme that, by design, produces solutions that are consistent with state-of-the-art physically based rendering. Our method combines an efficient forward model (a custom renderer for time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with high levels of noise or non-diffuse material reflectance.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Non-Line-of-Sight Mobile Positioning Using Factor Graphs
    Liu, Hongqing
    Chan, Frankie Kit Wing
    So, Hing Cheung
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2009, 58 (09) : 5279 - 5283
  • [32] Passive non-line-of-sight imaging using plenoptic information
    Lin, Di
    Hashemi, Connor
    Leger, James R.
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2020, 37 (04) : 540 - 551
  • [33] Reconstruction of multiple non-line-of-sight objects using back projection based on ellipsoid mode decomposition
    Jin, Chenfei
    Xie, Jiaheng
    Zhang, Siqi
    Zhang, Zijing
    Zhao, Yuan
    OPTICS EXPRESS, 2018, 26 (16): : 20089 - 20101
  • [34] Line-of-sight and non-line-of-sight vehicle-to-vehicle communication using light fidelity
    Nair, Nivedita
    Kaur, Sanmukh
    Sammal, Yatin Singh
    Bahl, Gaurja
    JOURNAL OF OPTICAL TECHNOLOGY, 2022, 89 (12) : 740 - 747
  • [35] Non-line-of-sight imaging with absorption backprojection
    Zhou, Hongyuan
    Zhang, Dejian
    Wang, Tongbiao
    Liao, Qinghua
    Yu, Tianbao
    APPLIED PHYSICS LETTERS, 2023, 123 (05)
  • [36] Non-parametric non-line-of-sight identification
    Gezici, S
    Kobayashi, H
    Poor, HV
    2003 IEEE 58TH VEHICULAR TECHNOLOGY CONFERENCE, VOLS1-5, PROCEEDINGS, 2003, : 2544 - 2548
  • [37] NLOST: Non-Line-of-Sight Imaging with Transformer
    Li, Yue
    Peng, Jiayong
    Ye, Juntian
    Zhang, Yueyi
    Xu, Feihu
    Xiong, Zhiwei
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13313 - 13322
  • [38] Non-line-of-sight fast tracking in a corridor
    Li, Tailin
    Luo, Yihan
    Xie, Zongliang
    Liu, Yaqing
    Xia, Shiye
    Xu, Shaoxiong
    Ren, Ge
    Ma, Haotong
    Qi, Bo
    Cao, Lei
    OPTICS EXPRESS, 2021, 29 (25) : 41568 - 41581
  • [39] Non-line-of-sight hard chromium alternatives
    Araguy, T
    Klingenberg, M
    Pavlik, M
    Schario, D
    AESF/EPA CONFERENCE FOR ENVIRONMENTAL EXCELLENCE, PROCEEDINGS, 2000, : 69 - 74
  • [40] CMFormer: Non-line-of-sight imaging with a memory-efficient MetaFormer network
    Zhang, Shihao
    Jin, Shaohui
    Liu, Hao
    Li, Yue
    Jiang, Xiaoheng
    Xu, Mingliang
    OPTICS AND LASERS IN ENGINEERING, 2025, 187