3D Mapping and 6D Pose Computation for Real Time Augmented Reality on Cylindrical Objects

被引:37
|
作者
Tang, Fulin [1 ]
Wu, Yihong [1 ]
Hou, Xiaohui [2 ]
Ling, Haibin [3 ]
机构
[1] Univ Chinese Acad Sci, Inst Automat Chinese Acad Sci, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[2] HiScene Informat Technol, Shanghai 200120, Peoples R China
[3] SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA
基金
中国国家自然科学基金;
关键词
Cameras; Three-dimensional displays; Image reconstruction; Augmented reality; Tracking; Solid modeling; Feature extraction; Augmented reality(AR); cylindrical object; reconstruction; tracking; linear P3P RANSAC; RECONSTRUCTION;
D O I
10.1109/TCSVT.2019.2950449
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual Augmented Reality (AR) typically overlays virtual computer graphics or other virtual contents on the real world videos, attracting much interest from both academic and industrial communities. Although AR techniques on planes are well studied, cylindrical objects are seldom used for augmented reality. In this paper, we propose a new method for 3D reconstruction and 6D pose computation for augmented reality on a cylindrical object. The 6D pose is the relative pose between the camera and the cylindrical object, which is very convenient to make augmented reality. First, we capture some images with a cylindrical object and then reconstruct its 3D model with textures offline by using projective invariance and image contours. Second, according to the 3D model, we track the 6D relative pose between the camera and the cylindrical object online, where we propose a linear P3P RANSAC to remove outliers. Finally, the virtual images are exactly aligned with the cylindrical object in the real world. Experimental results show that the proposed method outperforms the state of the arts in terms of 3D mapping and 6D pose computation on cylindrical objects.
引用
收藏
页码:2887 / 2899
页数:13
相关论文
共 50 条
  • [1] HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objects
    Kaskman, Roman
    Zakharov, Sergey
    Shugurov, Ivan
    Ilic, Slobodan
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2767 - 2776
  • [2] A regularized technique for real-time interposition of 3D objects in augmented reality
    Duchesne, A
    Hervé, JY
    [J]. INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOL 1-4, PROCEEDINGS, 2005, : 1402 - 1408
  • [3] CorNet: Generic 3D Corners for 6D Pose Estimation of New Objects without Retraining
    Pitteri, Giorgia
    Ilic, Slobodan
    Lepeutit, Vincent
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 2807 - 2815
  • [4] 3D Data Mapping with Augmented Reality
    Lee, Ming-Chun
    [J]. RECENT ADVANCES IN 3D GEOINFORMATION SCIENCE, 3D GEOINFO 2023, 2024, : 145 - 153
  • [5] Real-Time 6D Object Pose Estimation on CPU
    Konishi, Yoshinori
    Hattori, Kosuke
    Hashimoto, Manabu
    [J]. 2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 3451 - 3458
  • [6] 6D pose estimation and 3D object reconstruction from 2D shape for robotic grasping of objects
    Wolnitza, Marcell
    Kaya, Osman
    Kulvicius, Tomas
    Woergoetter, Florentin
    Dellen, Babette
    [J]. 2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 67 - 71
  • [7] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    [J]. PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142
  • [8] MONO6D: MONOCULAR VEHICLE 6D POSE ESTIMATION WITH 3D PRIORS
    Lyu, Yangxintong
    Royen, Remco
    Munteanu, Adrian
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2187 - 2191
  • [9] BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Models
    Wen, Bowen
    Bekris, Kostas
    [J]. 2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 8067 - 8074
  • [10] A Quick Algorithm for Snapping 3D Objects in Augmented Reality
    Trien V. Do
    Lee, Jong-Weon
    [J]. 2009 INTERNATIONAL SYMPOSIUM ON UBIQUITOUS VIRTUAL REALITY (ISUVR 2009), 2009, : 61 - +