Non-line-of-sight imaging with arbitrary illumination and detection pattern

被引:23
|
作者
Liu, Xintong [1 ]
Wang, Jianyu [1 ]
Xiao, Leping [2 ,3 ]
Shi, Zuoqiang [1 ,4 ]
Fu, Xing [2 ,3 ]
Qiu, Lingyun [1 ,4 ]
机构
[1] Tsinghua Univ, Yau Math Sci Ctr, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Key Lab Photon Control Technol, Minist Educ, Beijing 100084, Peoples R China
[4] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing 101408, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41467-023-38898-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The authors propose a confocal complemented signal-object collaborative regularization method for non-line-of-sight (NLOS) imaging without specific requirements on the spatial pattern of measurement points. The method extends the application range of NLOS imaging. Non-line-of-sight (NLOS) imaging aims at reconstructing targets obscured from the direct line of sight. Existing NLOS imaging algorithms require dense measurements at regular grid points in a large area of the relay surface, which severely hinders their availability to variable relay scenarios in practical applications such as robotic vision, autonomous driving, rescue operations and remote sensing. In this work, we propose a Bayesian framework for NLOS imaging without specific requirements on the spatial pattern of illumination and detection points. By introducing virtual confocal signals, we design a confocal complemented signal-object collaborative regularization (CC-SOCR) algorithm for high-quality reconstructions. Our approach is capable of reconstructing both the albedo and surface normal of the hidden objects with fine details under general relay settings. Moreover, with a regular relay surface, coarse rather than dense measurements are enough for our approach such that the acquisition time can be reduced significantly. As demonstrated in multiple experiments, the proposed framework substantially extends the application range of NLOS imaging.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Progress and prospect of non-line-of-sight imaging (invited)
    Jin X.
    Du D.
    Deng R.
    Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2022, 51 (08):
  • [32] Coherent Control of Light for Non-Line-of-Sight Imaging
    Starshynov, Ilya
    Ghafur, Omair
    Fitches, James
    Faccio, Daniele
    PHYSICAL REVIEW APPLIED, 2019, 12 (06)
  • [33] Speckle-correlation-based non-line-of-sight imaging under white-light illumination
    Zhou, Meiling
    Zhang, Yang
    Wang, Ping
    Li, Runze
    Peng, Tong
    Min, Junwei
    Yan, Shaohui
    Yao, Baoli
    OPTICS AND LASER TECHNOLOGY, 2024, 170
  • [34] Non-Line-of-Sight Radar
    Woolfson, Malcolm
    AERONAUTICAL JOURNAL, 2020, 124 (1282): : 2019 - 2020
  • [35] Non-line-of-sight imaging with picosecond optical-gated single photon detection
    Zhu, Shenyu
    Sua, Yong Meng
    Rehain, Patrick
    Huang, Yu-Ping
    2021 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2021,
  • [36] Efficient non-line-of-sight tracking with computational neuromorphic imaging
    Zhu, Shuo
    Ge, Zhou
    Wang, Chutian
    Han, Jing
    Lam, Edmund Y.
    OPTICS LETTERS, 2024, 49 (13) : 3584 - 3587
  • [37] Convolutional Approximations to the General Non-Line-of-Sight Imaging Operator
    Ahn, Byeongjoo
    Dave, Akshat
    Veeraraghavan, Ashok
    Gkioulekas, Ioannis
    Sankaranarayanan, Aswin C.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7888 - 7898
  • [38] Onsite Non-Line-of-Sight Imaging via Online Calibration
    Pan, Zhengqing
    Li, Ruiqian
    Gao, Tian
    Wang, Zi
    Shen, Siyuan
    Liu, Ping
    Wu, Tao
    Yu, Jingyi
    Li, Shiying
    IEEE PHOTONICS JOURNAL, 2022, 14 (05):
  • [39] Passive Non-Line-of-Sight Imaging Using Optimal Transport
    Geng, Ruixu
    Hu, Yang
    Lu, Zhi
    Yu, Cong
    Li, Houqiang
    Zhang, Hengyu
    Chen, Yan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 110 - 124
  • [40] Learned Feature Embeddings for Non-Line-of-Sight Imaging and Recognition
    Chen, Wenzheng
    Wei, Fangyin
    Kutulakos, Kiriakos N.
    Rusinkiewicz, Szymon
    Heide, Felix
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06):