Non-line-of-sight Reconstruction Using Efficient Transient Rendering

被引:33
|
作者
Iseringhausen, Julian [1 ]
Hullin, Matthias B. [1 ]
机构
[1] Univ Bonn, Inst Comp Sci 2, D-53115 Bonn, Germany
来源
ACM TRANSACTIONS ON GRAPHICS | 2020年 / 39卷 / 01期
基金
欧洲研究理事会;
关键词
Non-line-of-sight sensing; looking around corners;
D O I
10.1145/3368314
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Being able to see beyond the direct line of sight is an intriguing prospect and could benefit a wide variety of important applications. Recent work has demonstrated that time-resolved measurements of indirect diffuse light contain valuable information for reconstructing shape and reflectance properties of objects located around a corner. In this article, we introduce a novel reconstruction scheme that, by design, produces solutions that are consistent with state-of-the-art physically based rendering. Our method combines an efficient forward model (a custom renderer for time-resolved three-bounce indirect light transport) with an optimization framework to reconstruct object geometry in an analysis-by-synthesis sense. We evaluate our algorithm on a variety of synthetic and experimental input data, and show that it gracefully handles uncooperative scenes with high levels of noise or non-diffuse material reflectance.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Non-line-of-sight reconstruction with signal-object collaborative regularization
    Liu, Xintong
    Wang, Jianyu
    Li, Zhupeng
    Shi, Zuoqiang
    Fu, Xing
    Qiu, Lingyun
    LIGHT-SCIENCE & APPLICATIONS, 2021, 10 (01)
  • [22] Acoustic Non-Line-of-Sight Imaging
    Lindell, David B.
    Wetzstein, Gordon
    Koltun, Vladlen
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3773 - 6782
  • [23] High-quality reconstruction in non-line-of-sight imaging via transient multiplied photon count data
    Ma, Kai
    Wang, Xia
    He, Si
    Jin, Weiqi
    AOPC 2021: INFRARED DEVICE AND INFRARED TECHNOLOGY, 2021, 12061
  • [24] Confocal Non-line-of-sight Imaging
    O'Toole, Matthew
    Lindell, David B.
    Wetzstein, Gordon
    SIGGRAPH'18: ACM SIGGRAPH 2018 TALKS, 2018,
  • [25] Toward Non-Line-of-Sight Videography
    Feng, Xiaohua
    Gao, Liang
    Optics and Photonics News, 2021, 32 (11): : 22 - 29
  • [26] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [27] Polarized Non-Line-of-Sight Imaging
    Tanaka, Kenichiro
    Mukaigawa, Yasuhiro
    Kadambi, Achuta
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2133 - 2142
  • [28] Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging
    Feng, Xiaohua
    Gao, Liang
    NATURE COMMUNICATIONS, 2021, 12 (01)
  • [29] Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging
    Xiaohua Feng
    Liang Gao
    Nature Communications, 12
  • [30] Passive Non-Line-of-Sight Imaging Using Optimal Transport
    Geng, Ruixu
    Hu, Yang
    Lu, Zhi
    Yu, Cong
    Li, Houqiang
    Zhang, Hengyu
    Chen, Yan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 110 - 124