Real-Time Artifact Compensation for Depth Images of Multi-Frequency ToF

被引：0
|
作者：
Wang S. [1 ]
Wang R. [1 ]
Zuo X. [2 ]
Yu W. [1 ]
机构：
[1] School of Mechanical Engineering, Northwestern Polytechnical University, Xi'an
[2] School of Computer Science and Technology, Northwestern Polytechnical University, Xi'an
来源：
Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University | 2019年 / 37卷 / 01期
关键词：
Kernel density estimation; Kinect V2; Multi-frequency; Optical flow; ToF;
D O I：
10.1051/jnwpu/20193710152
中图分类号：
学科分类号：
摘要：
During the last few years, Time-of-Flight(TOF) sensor achieved a significant impact onto research and industrial fields due to that it can capture depth easily. For dynamic scenes and phase fusion, ToF sensor's working principles can lead to significant artifacts, therefore an efficient method to combine motion compensation and kernel density estimate multi-frequency unwrapping is proposed. Firstly, the raw multi-phase images are captured, then calculate the optical flow between each frequency. Secondly, by generating multiple depth hypotheses, uses a spatial kernel density estimation is used to rank them with wrapped phase images. Finally, the accurate depth from fused phase image is gotten. The algorithm on Kinect V2 is validated and the pixel-wise part is optimized using GPU. The method shows its real time superior performance on real datasets. © 2019 Journal of Northwestern Polytechnical University.
引用
收藏
页码：152 / 159
页数：7
相关论文
共 15 条
  • [1] Zuo X., Wang S., Zheng J., Et al., High-Speed Depth Stream Generation from a Hybrid Camera, ACM on Multimedia Conference, pp. 878-887, (2016)
  • [2] Lindner M., Kolb A., Lateral and Depth Calibration of PMD-Distance Sensors, International Symposium on Visual Computing, pp. 524-533, (2006)
  • [3] Hussmann S., Hermanski A., Edeler T., Real-Time Motion Artifact Suppression in TOF Camera Systems, IEEE Trans on Instrumentation & Measurement, 60, 5, pp. 1682-1690, (2011)
  • [4] Lindner M., Kolb A., Compensation of Motion Artifacts for Time-of-Flight Cameras, Dagm 2009 Workshop on Dynamic 3D Imaging, pp. 16-27, (2009)
  • [5] Lefloch D., Hoegg T., Kolb A., Real-Time Motion Artifacts Compensation of ToF Sensors Data on GPU, Three Dimensional Imaging, Visualization, and Distday International Society for Optics and Photonics, (2013)
  • [6] Crabb R., Manduchi R., Probabilistic Phase Unwrapping for Single-Frequency Time-of-Flight Range Cameras, International Conference on 3D Vision, pp. 577-584, (2014)
  • [7] Jongenelen A.P.P., Bailey D.G., Payne A.D., Et al., Analysis of Errors in ToF Range Imaging with Dual-Frequency Modulation, IEEE Trans on Instrumentation & Measurement, 60, 5, pp. 1861-1868, (2011)
  • [8] Droeschel D., Holz D., Behnke S., Multi-Frequency Phase Unwrapping for Time-of-Flight Cameras, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1463-1469, (2010)
  • [9] Ti C., Yang R., Davis J., Single-Shot Time-of-Flight Phase Unwrapping Using Two Modulation Frequencies, International Conference on 3D Vision, pp. 667-675, (2016)
  • [10] Lawin F.J., Forssen P.E., Ovren H., Efficient Multi-Frequency Phase Unwrapping Using Kernel Density Estimation, European Conference on Computer Vision, pp. 170-185, (2016)
12