Accurate and Scalable Contour-based Camera Pose Estimation Using Deep Learning With Synthetic Data

被引:1
|
作者
Hokmabadi, Ilyar Asl Sabbaghian [1 ]
Ai, Mengchi [1 ]
Minaretzis, Chrysostomos [1 ]
Sideris, Michael [1 ]
El-Sheimy, Naser [1 ]
机构
[1] Univ Calgary, Dept Geomat Engn, Calgary, AB, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Symmetric Objects; Deep Learning-based Pose Estimation; Shape-prior; Synthetic Data Generation; Indirect Pose Estimation;
D O I
10.1109/PLANS53410.2023.10139984
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Pose detection of objects is an important topic in object-level mapping and indoor localization. In the past, pose estimation methods were performed either with the help of artificial markers or natural features found on the object. However, due to the fact that the markers can only be utilized in controlled environment experiments, the application of marker-based approaches is very limited. Furthermore, methods that depend on the object's natural visual features require texture on the object and lack robustness to illumination and camera viewpoint variations. With the advent of Deep Learning (DL), the classical pose estimation methods have been outperformed. The DL-based pose estimation can detect deep features of the object and exhibits higher robustness to many distortions and variabilities caused by the changes in the illumination and viewpoint conditions. However, the massive training data set requirement is the main challenge with most DL-based methods. The training set is often a real set of images that have been manually labeled or annotated. In addition, such methods face problems related to the degradation of their predicted accuracy in the presence of uncertainties due to the symmetrical structure of many objects. To address the aforementioned issues, a novel and very fast method for generating synthetic data, as well as a contour-based technique for accurate pose estimation (that can handle pose ambiguities for a symmetrical object) are proposed in this paper. The tests that are conducted in multiple indoor scenarios demonstrate not only the effectiveness of the synthetic data generation but also exhibit, in many cases, the very high accuracy of the proposed pose estimation method.
引用
收藏
页码:1385 / 1393
页数:9
相关论文
共 50 条
  • [1] Transfer Learning from Synthetic Data in the Camera Pose Estimation Problem
    Charco, Jorge L.
    Sappa, Angel D.
    Vintimilla, Boris X.
    Velesaca, Henry O.
    [J]. VISAPP: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4: VISAPP, 2020, : 498 - 505
  • [2] Survey of Camera Pose Estimation Methods Based on Deep Learning
    Wang, Jing
    Jin, Yuchu
    Guo, Ping
    Hu, Shaoyi
    [J]. Computer Engineering and Applications, 2023, 59 (07) : 1 - 14
  • [3] Robust camera pose estimation by viewpoint classification using deep learning
    Nakajima Y.
    Saito H.
    [J]. Computational Visual Media, 2017, 3 (2) : 189 - 198
  • [4] Robust camera pose estimation by viewpoint classification using deep learning
    Yoshikatsu Nakajima
    Hideo Saito
    [J]. Computational Visual Media, 2017, 3 (02) : 189 - 198
  • [5] Prediction of liver Dmean for proton beam therapy using deep learning and contour-based data augmentation
    Jampa-ngern, Sira
    Kobashi, Keiji
    Shimizu, Shinichi
    Takao, Seishin
    Nakazato, Keiji
    Shirato, Hiroki
    [J]. JOURNAL OF RADIATION RESEARCH, 2021, 62 (06) : 1120 - 1129
  • [6] Contour-based iterative pose estimation of 3D rigid object
    Leng, D. W.
    Sun, W. D.
    [J]. IET COMPUTER VISION, 2011, 5 (05) : 291 - 300
  • [7] Crane pose estimation using deep learning models and synthetic images
    Park, Gyuha
    Hong, Hyosung
    Jeong, Hyeonho
    Kang, Hojun
    Won, Mooncheol
    [J]. Journal of Institute of Control, Robotics and Systems, 2021, 27 (04) : 312 - 319
  • [8] RCPNet: Deep-Learning based Relative Camera Pose Estimation for UAVs
    Yang, Chenhao
    Liu, Yuyi
    Zell, Andreas
    [J]. 2020 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'20), 2020, : 1085 - 1092
  • [9] Deep learning based camera pose estimation in multi-view environment
    Charco, Jorge L.
    Vintimilla, Boris X.
    Sappa, Angel D.
    [J]. 2018 14TH INTERNATIONAL CONFERENCE ON SIGNAL IMAGE TECHNOLOGY & INTERNET BASED SYSTEMS (SITIS), 2018, : 224 - 228
  • [10] In-cabin vehicle synthetic data to test Deep Learning based human pose estimation models
    Ribas, Luis Gustavo Tomal
    Cocron, Marta Pereira
    da Silva, Joed Lopes
    Zimmer, Alessandro
    Brandmeier, Thomas
    [J]. 2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 610 - 615