A Deblurring Method for Indirect Time-of-Flight Depth Sensor

被引:3
|
作者
Gao, Jing [1 ,2 ]
Gao, Xueqiang [1 ,2 ]
Nie, Kaiming [1 ,2 ]
Gao, Zhiyuan [1 ,2 ]
Xu, Jiangtao [1 ,2 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Tianjin Key Lab Imaging & Sensing Microelect Techn, Tianjin 300072, Peoples R China
关键词
Cameras; Sensor phenomena and characterization; Imaging; Image sensors; Time measurement; Three-dimensional displays; Phase measurement; Charge correction; deblurring method; indirect time-of-flight (iToF) depth sensor; motion blur;
D O I
10.1109/JSEN.2022.3229687
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Indirect time-of-flight (iToF) depth sensors can obtain depth from the phase offset between emitted and received modulated infrared (IR) pulsed light. However, these sensors suffer from motion blur artifacts when there are moving objects in the scene causing depth measurement distortion. By analyzing the mechanism of motion blur, this article summarizes motion blur into categories: half-frame motion blur and full-frame motion blur. For both blur categories, this article, respectively, proposes the deblurring method based on charge correction with the adjacent frame charge reference and the neighborhood similar charge reference. Based on the range resolution equation, the proposed pixel-based blur detection method can adaptively detect motion blur. For detected blurred pixels, the proposed deblurring method removes blur by recalculating the depth of blurred pixels. Motion blur was suppressed at 30 frames/s owing to the proposed deblurring method. The depth error is about 1.68% over the range of 1-2 m, with a modulation frequency of 40 MHz. Experimental results demonstrate that the proposed deblurring method can effectively eliminate the motion blur of moving objects with minimal computational cost.
引用
收藏
页码:2718 / 2726
页数:9
相关论文
共 50 条
  • [1] Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
    Xiao, Lei
    Heide, Felix
    O'Toole, Matthew
    Kolb, Andreas
    Hullin, Matthias B.
    Kutulakos, Kyros
    Heidrich, Wolfgang
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2376 - 2384
  • [2] Time-of-Flight Depth Camera Motion Blur Detection and Deblurring
    Lee, Seungkyu
    IEEE SIGNAL PROCESSING LETTERS, 2014, 21 (06) : 663 - 666
  • [3] An Indirect Time-of-Flight Sensor with Adaptive Multiple Sampling for High Depth Precision
    Hwang, Jung-Hye
    Kang, Jubin
    Park, Yongjae
    Son, Insang
    Hong, Kieop
    Kim, Seong-Jin
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [4] Hybrid exposure for depth imaging of a time-of-flight depth sensor
    Shim, Hyunjung
    Lee, Seungkyu
    OPTICS EXPRESS, 2014, 22 (11): : 13393 - 13402
  • [5] Indirect Time-of-Flight Depth Sensor with Two-Step Comparison Scheme for Depth Frame Difference Detection
    Kim, Donguk
    Choi, Jaehyuk
    SENSORS, 2019, 19 (17)
  • [6] Analyzing the potential of a time-of-flight depth sensor for assembly assistance
    Niedermayr, Daniel
    Wolfartsberger, Josef
    3RD INTERNATIONAL CONFERENCE ON INDUSTRY 4.0 AND SMART MANUFACTURING, 2022, 200 : 648 - 659
  • [7] TIME-OF-FLIGHT SENSOR FUSION WITH DEPTH MEASUREMENT RELIABILITY WEIGHTING
    Schwarz, Sebastian
    Sjostrom, Marten
    Olsson, Roger
    2014 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2014,
  • [8] TIME-OF-FLIGHT SENSOR DEPTH ENHANCEMENT FOR AUTOMOTIVE EXHAUST GAS
    Yoshida, Tomonari
    Wasenmueller, Oliver
    Stricker, Didier
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1955 - 1959
  • [9] Time-of-Flight Sensor Calibration for a Color and Depth Camera Pair
    Jung, Jiyoung
    Lee, Joon-Young
    Jeong, Yekeun
    Kweon, In So
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (07) : 1501 - 1513
  • [10] A 70mW Indirect Time-of-Flight Image Sensor with Depth Dynamic Range Enhancement and Fixed Depth Noise Compensation
    Piao, Canxing
    Ahn, Yeonsoo
    Kim, Donguk
    Park, Jihoon
    Kang, Jubin
    Shin, Minseok
    Seo, Kangbong
    Kim, Seong-Jin
    Chun, Jung-Hoon
    Choi, Jaehyuk
    IEEE ASIAN SOLID-STATE CIRCUITS CONFERENCE (A-SSCC 2021), 2021,