Depth completion for kinect v2 sensor

被引:8
|
作者
Song, Wanbin [1 ]
Anh Vu Le [1 ]
Yun, Seokmin [1 ]
Jung, Seung-Won [2 ]
Won, Chee Sun [1 ]
机构
[1] Dongguk Univ Seoul, Dept Elect & Elect Engn, 26 Pildongro1 Gil, Seoul 100715, South Korea
[2] Dongguk Univ Seoul, Dept Multimedia Engn, 26 Pildongro1 Gil, Seoul 100715, South Korea
基金
新加坡国家研究基金会;
关键词
Kinect v2; Hole-filling; Depth completion; Depth and color fusion;
D O I
10.1007/s11042-016-3523-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Kinect v2 adopts a time-of-flight (ToF) depth sensing mechanism, which causes different type of depth artifacts comparing to the original Kinect v1. The goal of this paper is to propose a depth completion method, which is designed especially for the Kinect v2 depth artifacts. Observing the specific types of depth errors in the Kinect v2 such as thin hole-lines along the object boundaries and the new type of holes in the image corners, in this paper, we exploit the position information of the color edges extracted from the Kinect v2 sensor to guide the accurate hole-filling around the object boundaries. Since our approach requires a precise registration between color and depth images, we also introduce the transformation matrix which yields point-to-point correspondence with a pixel-accuracy. Experimental results demonstrate the effectiveness of the proposed depth image completion algorithm for the Kinect v2 in terms of completion accuracy and execution time.
引用
收藏
页码:4357 / 4380
页数:24
相关论文
共 50 条
  • [1] Depth completion for kinect v2 sensor
    Wanbin Song
    Anh Vu Le
    Seokmin Yun
    Seung-Won Jung
    Chee Sun Won
    [J]. Multimedia Tools and Applications, 2017, 76 : 4357 - 4380
  • [2] Depth analysis of kinect v2 sensor in different mediums
    Bhateja, Aditi
    Shrivastav, Adarsh
    Chaudhary, Himanshu
    Lall, Brejesh
    Kalra, Prem K.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (25) : 35775 - 35800
  • [3] Depth analysis of kinect v2 sensor in different mediums
    Aditi Bhateja
    Adarsh Shrivastav
    Himanshu Chaudhary
    Brejesh Lall
    Prem K Kalra
    [J]. Multimedia Tools and Applications, 2022, 81 : 35775 - 35800
  • [4] Correction to: depth analysis of kinect v2 sensor in different mediums
    Aditi Bhateja
    Adarsh Shrivastav
    Himanshu Chaudhary
    Brejesh Lall
    Prem K. Kalra
    [J]. Multimedia Tools and Applications, 2022, 81 (25) : 35801 - 35801
  • [5] Depth Assisted Palm Region Extraction using the Kinect v2 Sensor
    Samoil, S.
    Yanushkevich, S. N.
    [J]. 2015 SIXTH INTERNATIONAL CONFERENCE ON EMERGING SECURITY TECHNOLOGIES (EST), 2015, : 74 - 79
  • [6] Banana Pseudostem Width Detection Based on Kinect V2 Depth Sensor
    Wang, Jinzhi
    Li, Xiuhua
    Zhou, Yonghua
    Wang, Huaihai
    Li, Minzan
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [7] Color and Depth Image Correspondence for Kinect v2
    Kim, Changhee
    Yun, Seokmin
    Jung, Seung-Won
    Won, Chee Sun
    [J]. ADVANCED MULTIMEDIA AND UBIQUITOUS ENGINEERING: FUTURE INFORMATION TECHNOLOGY, 2015, 352 : 111 - 116
  • [8] Color and Depth Image Correspondence for Kinect v2
    Kim, Changhee
    Yun, Seokmin
    Jung, Seung-Won
    Won, Chee Sun
    [J]. ADVANCED MULTIMEDIA AND UBIQUITOUS ENGINEERING: FUTURE INFORMATION TECHNOLOGY, VOL 2, 2016, 354 : 333 - 340
  • [9] A Linear Method for Recovering the Depth of Ultra HD Cameras Using a Kinect V2 Sensor
    Gao, Yuan
    Ziegler, Matthias
    Zilly, Frederik
    Esquivel, Sandro
    Koch, Reinhard
    [J]. PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 494 - 497
  • [10] A depth image acquisition platform based on Kinect V2
    Zhai, Yu
    Qu, Yanlin
    Xu, Peng
    Li, Mengyao
    Han, Shaokun
    [J]. AOPC 2021: OPTICAL SENSING AND IMAGING TECHNOLOGY, 2021, 12065