A Post-Rectification Approach of Depth Images of Kinect v2 for 3D Reconstruction of Indoor Scenes

被引:25
|
作者
Jiao, Jichao [1 ]
Yuan, Libin [1 ]
Tang, Weihua [2 ]
Deng, Zhongliang [1 ]
Wu, Qi [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
[2] China State Construct Engn Corp Ltd CSCEC, Beijing 100876, Peoples R China
基金
中国国家自然科学基金;
关键词
camera calibration; Kinect v2; reflectivity-related depth error; simultaneous localization and mapping (SLAM); time-of-flight; RGB-D CAMERA; CALIBRATION; SENSORS;
D O I
10.3390/ijgi6110349
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D reconstruction of indoor scenes is a hot research topic in computer vision. Reconstructing fast, low-cost, and accurate dense 3D maps of indoor scenes have applications in indoor robot positioning, navigation, and semantic mapping. In other studies, the Microsoft Kinect for Windows v2 (Kinect v2) is utilized to complete this task, however, the accuracy and precision of depth information and the accuracy of correspondence between the RGB and depth (RGB-D) images still remain to be improved. In this paper, we propose a post-rectification approach of the depth images to improve the accuracy and precision of depth information. Firstly, we calibrate the Kinect v2 with a planar checkerboard pattern. Secondly, we propose a post-rectification approach of the depth images according to the reflectivity-related depth error. Finally, we conduct tests to evaluate this post-rectification approach from the perspectives of accuracy and precision. In order to validate the effect of our post-rectification approach, we apply it to RGB-D simultaneous localization and mapping (SLAM) in an indoor environment. Experimental results show that once our post-rectification approach is employed, the RGB-D SLAM system can perform a more accurate and better visual effect 3D reconstruction of indoor scenes than other state-of-the-art methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Reconstruction of 3D scenes from sequences of images
    Niu Bei
    Sang Xin-zhu
    Chen Duo
    Cai Yuan-fa
    [J]. INTERNATIONAL SYMPOSIUM ON PHOTOELECTRONIC DETECTION AND IMAGING 2013: OPTICAL STORAGE AND DISPLAY TECHNOLOGY, 2013, 8913
  • [22] LaserBrush: A Flexible Device for 3D Reconstruction of Indoor Scenes
    Habbecke, Martin
    Kobbelt, Leif
    [J]. SPM 2008: PROCEEDINGS OF THE ACM SOLID AND PHYSICAL MODELING SYMPOSIUM, 2008, : 231 - 239
  • [23] A 3D Reconstruction System of Indoor Scenes with Rotating Platform
    Zhang, Feng
    Shi, Limin
    Xu, Zhenhui
    Hu, Zhanyi
    [J]. ISCSCT 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND COMPUTATIONAL TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 554 - 558
  • [24] 3D Reconstruction of Indoor Scenes via Image Registration
    Ce Li
    Bing Lu
    Yachao Zhang
    Hao Liu
    Yanyun Qu
    [J]. Neural Processing Letters, 2018, 48 : 1281 - 1304
  • [25] 3D Reconstruction of Indoor Scenes via Image Registration
    Li, Ce
    Lu, Bing
    Zhang, Yachao
    Liu, Hao
    Qu, Yanyun
    [J]. NEURAL PROCESSING LETTERS, 2018, 48 (03) : 1281 - 1304
  • [26] 3D indoor reconstruction using Kinect sensor with locality constraint
    Zhu, Peng
    Guo, YanGuang
    [J]. INTERNATIONAL JOURNAL OF MODELLING IDENTIFICATION AND CONTROL, 2023, 42 (01) : 46 - 53
  • [27] DEPTH MAP ENHANCEMENT ON RGB-D VIDEO CAPTURED BY KINECT V2
    Lin, Ke-Yu
    Hang, Hsueh-Ming
    [J]. 2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 1530 - 1535
  • [28] Automated reconstruction of 3D scenes from sequences of images
    Pollefeys, M
    Koch, R
    Vergauwen, M
    Van Gool, L
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2000, 55 (04) : 251 - 267
  • [29] Method to Convert Kinect's 3D Depth Data to a 2D Map for Indoor SLAM
    Kamarudin, Kamarulzaman
    Mamduh, Syed Muhammad
    Shakaff, Ali Yeon Md
    Saad, Shaharil Mad
    Zakaria, Ammar
    Abdullah, Abu Hassan
    Kamarudin, Latifah Munirah
    [J]. 2013 IEEE 9TH INTERNATIONAL COLLOQUIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS (CSPA), 2013, : 247 - 251
  • [30] Learning to Synthesize 3D Indoor Scenes from Monocular Images
    Zhu, Fan
    Liu, Li
    Xie, Jin
    Shen, Fumin
    Shao, Ling
    Fang, Yi
    [J]. PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 501 - 509