Non-line-of-sight Reconstruction Using Efficient Transient Rendering

被引:33
|
作者
Iseringhausen, Julian [1 ]
Hullin, Matthias B. [1 ]
机构
[1] Univ Bonn, Inst Comp Sci 2, D-53115 Bonn, Germany
来源
ACM TRANSACTIONS ON GRAPHICS | 2020年 / 39卷 / 01期
基金
欧洲研究理事会;
关键词
Non-line-of-sight sensing; looking around corners;
D O I
10.1145/3368314
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Being able to see beyond the direct line of sight is an intriguing prospect and could benefit a wide variety of important applications. Recent work has demonstrated that time-resolved measurements of indirect diffuse light contain valuable information for reconstructing shape and reflectance properties of objects located around a corner. In this article, we introduce a novel reconstruction scheme that, by design, produces solutions that are consistent with state-of-the-art physically based rendering. Our method combines an efficient forward model (a custom renderer for time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with high levels of noise or non-diffuse material reflectance.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Non-line-of-sight transient rendering
    Royo, Diego
    Garcia, Jorge
    Munoz, Adolfo
    Jarabo, Adrian
    COMPUTERS & GRAPHICS-UK, 2022, 107 : 84 - 92
  • [2] Fast Differentiable Transient Rendering for Non-Line-of-Sight Reconstruction
    Plack, Markus
    Callenberg, Clara
    Schneider, Monika
    Hullin, Matthias B.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 3066 - 3075
  • [3] Non-Line-of-Sight Transient Rendering
    Royo, Diego
    Garcia, Jorge
    Luesia-Lahoz, Pablo
    Marco, Julio
    Gutierrez, Diego
    Munoz, Adolfo
    Jarabo, Adrian
    PROCEEDINGS OF SIGGRAPH 2022 POSTERS, SIGGRAPH 2022, 2022,
  • [4] Deep Non-Line-Of-Sight Reconstruction
    Chopite, Javier Grau
    Hullin, Matthias B.
    Wand, Michael
    Iseringhausen, Julian
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 957 - 966
  • [5] Photon-Efficient Non-Line-of-Sight Imaging
    Liu, Jianjiang
    Zhou, Yijun
    Huang, Xin
    Li, Zheng-Ping
    Xu, Feihu
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 639 - 650
  • [6] Non-line-of-Sight Imaging via Neural Transient Fields
    Shen, Siyuan
    Wang, Zi
    Liu, Ping
    Pan, Zhengqing
    Li, Ruiqian
    Gao, Tian
    Li, Shiying
    Yu, Jingyi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) : 2257 - 2268
  • [7] Non-line-of-sight reconstruction via structure sparsity regularization
    Huang, Duolan
    Chen, Quan
    Wei, Zhun
    Chen, Rui
    OPTICS LETTERS, 2023, 48 (18) : 4881 - 4884
  • [8] A Theory of Fermat Paths for Non-Line-of-Sight Shape Reconstruction
    Xin, Shumian
    Nousias, Sotiris
    Kutulakos, Kiriakos N.
    Sankaranarayanan, Aswin C.
    Narasimhan, Srinivasa G.
    Gkioulekas, Ioannis
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 6793 - 6802
  • [9] Improving non-line-of-sight age reconstruction with weighting factors
    Feng, Xiaohua
    Gao, Liang
    OPTICS LETTERS, 2020, 45 (14) : 3917 - 3920
  • [10] Investigation of some limitations of non-line-of-sight scene reconstruction
    Laurenzis, Martin
    EMERGING IMAGING AND SENSING TECHNOLOGIES FOR SECURITY AND DEFENCE V; AND ADVANCED MANUFACTURING TECHNOLOGIES FOR MICRO- AND NANOSYSTEMS IN SECURITY AND DEFENCE III, 2020, 11540