A Deblurring Method for Indirect Time-of-Flight Depth Sensor

被引:3
|
作者
Gao, Jing [1 ,2 ]
Gao, Xueqiang [1 ,2 ]
Nie, Kaiming [1 ,2 ]
Gao, Zhiyuan [1 ,2 ]
Xu, Jiangtao [1 ,2 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Tianjin Key Lab Imaging & Sensing Microelect Techn, Tianjin 300072, Peoples R China
关键词
Cameras; Sensor phenomena and characterization; Imaging; Image sensors; Time measurement; Three-dimensional displays; Phase measurement; Charge correction; deblurring method; indirect time-of-flight (iToF) depth sensor; motion blur;
D O I
10.1109/JSEN.2022.3229687
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Indirect time-of-flight (iToF) depth sensors can obtain depth from the phase offset between emitted and received modulated infrared (IR) pulsed light. However, these sensors suffer from motion blur artifacts when there are moving objects in the scene causing depth measurement distortion. By analyzing the mechanism of motion blur, this article summarizes motion blur into categories: half-frame motion blur and full-frame motion blur. For both blur categories, this article, respectively, proposes the deblurring method based on charge correction with the adjacent frame charge reference and the neighborhood similar charge reference. Based on the range resolution equation, the proposed pixel-based blur detection method can adaptively detect motion blur. For detected blurred pixels, the proposed deblurring method removes blur by recalculating the depth of blurred pixels. Motion blur was suppressed at 30 frames/s owing to the proposed deblurring method. The depth error is about 1.68% over the range of 1-2 m, with a modulation frequency of 40 MHz. Experimental results demonstrate that the proposed deblurring method can effectively eliminate the motion blur of moving objects with minimal computational cost.
引用
收藏
页码:2718 / 2726
页数:9
相关论文
共 50 条
  • [31] A Low-Power Indirect Time-of-Flight CMOS Image Sensor With Fixed Depth Noise Compensation and Dual-Mode Imaging for Depth Dynamic Range Enhancement
    Piao, Canxing
    Ahn, Yeonsoo
    Kim, Donguk
    Park, Jihoon
    Kang, Jubin
    Kim, Seong-Jin
    Chun, Jung-Hoon
    Choi, Jaehyuk
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (10) : 3989 - 3999
  • [32] Wild ToFu: Improving Range and Quality of Indirect Time-of-Flight Depth with RGB Fusion in Challenging Environments
    Jung, HyunJun
    Brasch, Nikolas
    Leonardis, Ales
    Navab, Nassir
    Busam, Benjamin
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 239 - 248
  • [33] Fusion of time-of-flight depth and stereo for high accuracy depth maps
    Zhu, Jiejie
    Wang, Liang
    Yang, Ruigang
    Davis, James
    2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 3262 - +
  • [34] A time-of-flight line sensor - Development and application
    Kaufmann, R
    Lehmann, M
    Schweizer, M
    Richter, M
    Metzler, P
    Lang, G
    Oggier, T
    Blanc, N
    Seitz, P
    Gruener, G
    Zbinden, U
    OPTICAL SENSING, 2004, 5459 : 192 - 199
  • [35] Synthetic Thermal Time-of-Flight(STTOF) depth imaging
    Ringermacher, HI
    Howard, DR
    REVIEW OF PROGRESS IN QUANTITATIVE NONDESTRUCTIVE EVALUATION, VOLS 20A AND 20B, 2001, 557 : 487 - 491
  • [36] VCSEL array for compact time-of-flight sensor
    Jakobsen, ML
    Osten, S
    Kitchen, SR
    Dam-Hansen, C
    Hanson, SG
    APPLICATIONS OF PHOTONIC TECHNOLOGY 6: CLOSING THE GAP BETWEEN THEORY, DEVELOPMENT, AND APPLICATION, 2003, 5260 : 119 - 126
  • [37] Time-of-flight sensor for respiratory motion gating
    Schaller, Christian
    Penne, Jochen
    Hornegger, Joachim
    MEDICAL PHYSICS, 2008, 35 (07) : 3090 - 3093
  • [38] Assessment of pulmonary function using an infrared Time-of-Flight depth image sensor in patients with COPD
    Tanaka, Satoshi
    Nishine, Hiroki
    Utsunomiya, Kentaro
    Sato, Shohei
    Masui, Takemi
    Handa, Hiroshi
    Mineshita, Masamichi
    EUROPEAN RESPIRATORY JOURNAL, 2024, 64
  • [39] Depth sensing with time-of-flight and stereovision - preliminary experiments
    Moranski, Marcin
    Materka, Andrzej
    SPA 2009: SIGNAL PROCESSING ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS CONFERENCE PROCEEDINGS, 2009, : 57 - 61
  • [40] Iterative Error Removal for Time-of-Flight Depth Imaging
    Zheng, Zhuolin
    Ding, Yinzhang
    Tang, Xiaotian
    Cai, Yu
    Li, Dongxiao
    Zhang, Ming
    Xie, Hongyang
    Li, Xuanfu
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 92 - 105