Camera pose estimation based on 2D image and 3D point cloud fusion

被引：0
|
作者：
Zhou J.-L. [1 ]
Zhu B. [1 ]
Wu Z.-L. [1 ]
机构：
[1] College of Electronic and Information Engineering, Harbin Institute of Technology, Harbin
来源：
Guangxue Jingmi Gongcheng/Optics and Precision Engineering | 2022年 / 30卷 / 22期
关键词：
camera pose estimation; feature matching; point cloud; scene regression;
D O I：
10.37188/OPE.20223022.2901
中图分类号：
学科分类号：
摘要：
This paper presents an estimation algorithm for the six degree-of-freedom camera pose obtained from a single RGB image in a specific environment using a combination of the known image and point cloud information. Specifically，we propose a multi-stage camera pose estimation algorithm based on dense scene regression. First，the camera pose estimation dataset is composed by combining the depth image information and Structure from Motion （SFM） algorithm. Then，for the first time，we introduce depth image retrieval into the construction of two- and three-dimensional （2D-3D） matching points. Using the proposed pose optimization function，a multi-stage camera pose estimation method is proposed. The ResNet network considerably improves the pose estimation accuracy. Experimental results indicate that the pose estimation accuracy is 82.7% on average in the open dataset 7 scenes，and 94.8% in our own dataset（estimated poses falling within the threshold of 5 cm/5°）. Compared with other camera pose estimation methods，our method has better pose estimation accuracy for both our and public datasets. © 2022 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码：2901 / 2912
页数：11
相关论文
共 20 条
  • [1] Accurate localization and pose estimation for large 3D models［C］, 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 532-539, (2014)
  • [2] LIU L, DAI Y C., Efficient global 2D-3D matching for camera localization in a large-scale 3D map［C］, 2017 IEEE International Conference on Computer Vision, pp. 2391-2400, (2017)
  • [3] Uncertainty-aware camera pose estimation from points and lines［C］, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）, pp. 4657-4666, (2021)
  • [4] High-precision camera pose estimation and optimization in a large-scene 3D reconstruction system［J］, Measurement Science and Technology, 31, 8, (2020)
  • [5] KENDALL A, GRIMES M, CIPOLLA R., PoseNet：a convolutional network for real-time 6-DOF camera relocalization［C］, 2015 IEEE International Conference on Computer Vision, pp. 2938-2946, (2015)
  • [6] SATTLER T, Et al., Understanding the limitations of CNN-based absolute camera pose regression［C］, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）, pp. 3297-3307, (2019)
  • [7] CHEN Z T，, JACOBSON A, SUNDERHAUF N，, Et al., Deep learning features at scale for visual place recognition［C］, 2017 IEEE International Conference on Robotics and Automation, pp. 3223-3230, (2017)
  • [8] ZHU J S, Et al., Relative geometry-aware Siamese neural network for 6DOF camera relocalization ［J］, Neurocomputing, 426, pp. 134-146, (2021)
  • [9] TANG S T, TANG C Z，, HUANG R，, Et al., Learning camera localization via dense scene matching［C］, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition （CVPR）, pp. 1831-1841
  • [10] LIU D SH, Et al., Three-dimensional reconstruction of large-scale scene based on depth camera［J］, Opt. Precision Eng, 28, 1, pp. 234-243, (2020)
12