Non-line-of-sight imaging with arbitrary illumination and detection pattern

被引:23
|
作者
Liu, Xintong [1 ]
Wang, Jianyu [1 ]
Xiao, Leping [2 ,3 ]
Shi, Zuoqiang [1 ,4 ]
Fu, Xing [2 ,3 ]
Qiu, Lingyun [1 ,4 ]
机构
[1] Tsinghua Univ, Yau Math Sci Ctr, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Dept Precis Instrument, State Key Lab Precis Measurement Technol & Instrum, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Key Lab Photon Control Technol, Minist Educ, Beijing 100084, Peoples R China
[4] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing 101408, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1038/s41467-023-38898-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The authors propose a confocal complemented signal-object collaborative regularization method for non-line-of-sight (NLOS) imaging without specific requirements on the spatial pattern of measurement points. The method extends the application range of NLOS imaging. Non-line-of-sight (NLOS) imaging aims at reconstructing targets obscured from the direct line of sight. Existing NLOS imaging algorithms require dense measurements at regular grid points in a large area of the relay surface, which severely hinders their availability to variable relay scenarios in practical applications such as robotic vision, autonomous driving, rescue operations and remote sensing. In this work, we propose a Bayesian framework for NLOS imaging without specific requirements on the spatial pattern of illumination and detection points. By introducing virtual confocal signals, we design a confocal complemented signal-object collaborative regularization (CC-SOCR) algorithm for high-quality reconstructions. Our approach is capable of reconstructing both the albedo and surface normal of the hidden objects with fine details under general relay settings. Moreover, with a regular relay surface, coarse rather than dense measurements are enough for our approach such that the acquisition time can be reduced significantly. As demonstrated in multiple experiments, the proposed framework substantially extends the application range of NLOS imaging.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Passive Non-Line-of-Sight Imaging With Light Transport Modulation
    Zhang, Jiarui
    Geng, Ruixu
    Du, Xiaolong
    Chen, Yan
    Li, Houqiang
    Hu, Yang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 410 - 424
  • [42] Non-line-of-Sight Imaging via Neural Transient Fields
    Shen, Siyuan
    Wang, Zi
    Liu, Ping
    Pan, Zhengqing
    Li, Ruiqian
    Gao, Tian
    Li, Shiying
    Yu, Jingyi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) : 2257 - 2268
  • [43] The role of Wigner Distribution Function in Non-Line-of-Sight Imaging
    Liu, Xiaochun
    Velten, Andreas
    2020 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2020,
  • [44] Passive non-line-of-sight imaging using plenoptic information
    Lin, Di
    Hashemi, Connor
    Leger, James R.
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2020, 37 (04) : 540 - 551
  • [45] Virtual light transport matrices for non-line-of-sight imaging
    Marco, Julio
    Jarabo, Adrian
    Nam, Ji Hyun
    Liu, Xiaochun
    Cosculluela, Miguel Angel
    Velten, Andreas
    Gutierrez, Diego
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2420 - 2429
  • [46] ON THE EFFECT OF REFLECTANCE ON PHASOR FIELD NON-LINE-OF-SIGHT IMAGING
    Guillen, Ibon
    Liu, Xiaochun
    Velten, Andreas
    Gutierrez, Diego
    Jarabo, Adrian
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 9269 - 9273
  • [47] Influence of Target Surface BRDF on Non-Line-of-Sight Imaging
    Yang, Yufeng
    Yang, Kailei
    Zhang, Ao
    JOURNAL OF IMAGING, 2024, 10 (11)
  • [48] Non-line-of-sight imaging based on Archimedean spiral scanning
    Zhang, Meiling
    Shi, Yaoyao
    Sheng, Wei
    Liu, Jiaqing
    Li, Jingwen
    Wei, Yang
    Wang, Bin
    Zhang, Dejin
    Liu, Youwen
    OPTICS COMMUNICATIONS, 2023, 537
  • [49] Influence of Target Surface BRDF on Non-Line-of-Sight Imaging
    Yang Yufeng
    Zhang Ao
    Guo Youcheng
    Zhu Wenzhuo
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (18)
  • [50] Multi-Modal Non-Line-of-Sight Passive Imaging
    Beckus, Andre
    Tamasan, Alexandru
    Ati, George K.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) : 3372 - 3382