A fast object registration method for augmented reality assembly with simultaneous determination of multiple 2D-3D correspondences

被引:30
|
作者
Wang, Ke [1 ]
Liu, Daxin [1 ]
Liu, Zhenyu [1 ]
Duan, Guifang [1 ]
Hu, Liang [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Augmented reality; Registration; Pose estimation; Monocular image; Geometric feature; Assembly guidance; POSE ESTIMATION; VISUAL TRACKING; VISUALIZATION; LOCALIZATION; RECOGNITION;
D O I
10.1016/j.rcim.2019.101890
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A fast and robust object registration is one of the fundamental steps of an augmented reality (AR) assembly guidance system. To manage the registration of texture-less objects from monocular images, this paper presents a three-dimensional (3D) object registration solution in the view-based framework, which incorporates a new image feature named as chain-of-lines feature (COLF). The COLF, constructed by several directed line segments with geometric constraints, enhances the robustness of the registration by establishing multiple correspondences between the two-dimensional (2D) image and 3D model simultaneously. In order to save on computational cost and improve the efficiency of the COLF-based registration, a compression algorithm based on the local breadth-first search (LBFS) strategy is also proposed; this adaptively reduces the number of keyframes according to the target model. In the experimental evaluation, the combination of COLF and LBFS-based keyframe compression shows higher registration success rate and faster speed in comparison with conventional registration methods. Moreover, an AR assembly guidance prototype system for reductors is introduced to illustrate the application of the proposed registration method.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Augmented reality based on fast deformable 2D-3D registration for image guided surgery
    Scheuering, M
    Rezk-Salama, C
    Barfuss, H
    Schneider, A
    Greiner, G
    [J]. MEDICAL IMAGING 2002: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND DISPLAY, 2002, 4681 : 436 - 445
  • [2] A spatial registration method based on 2D-3D registration for an augmented reality spinal surgery navigation system
    Zhang, Jingqi
    Yang, Zhiyong
    Jiang, Shan
    Zhou, Zeyang
    [J]. INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2024, 20 (01):
  • [3] Globally Optimal 2D-3D Registration from Points or Lines Without Correspondences
    Brown, Mark
    Windridge, David
    Guillemaut, Jean-Yves
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2111 - 2119
  • [4] Fast 2D-3D registration for navigation system of surgical robot
    Iwashita, Y
    Kurazume, R
    Hasegawa, T
    Konishi, K
    Nakamoto, M
    Hashizume, M
    [J]. 2005 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-4, 2005, : 897 - 903
  • [5] Multiple 3D Object Tracking for Augmented Reality
    Park, Youngmin
    Lepetit, Vincent
    Woo, Woontack
    [J]. 7TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY 2008, PROCEEDINGS, 2008, : 117 - 120
  • [6] Enriching Object Detection with 2D-3D Registration and Continuous Viewpoint Estimation
    Choy, Christopher Bongsoo
    Stark, Michael
    Corbett-Davies, Sam
    Savarese, Silvio
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 2512 - 2520
  • [7] Fast 2D-3D registration using GPU-based preprocessing
    Kim, K
    Park, S
    Hong, H
    Shin, YG
    [J]. Healthcom 2005: 7th International Workshop on Enterprise Networking and Computing in Healthcare Industry, Proceedings, 2005, : 139 - 143
  • [8] A robust technique for 2D-3D registration
    Gong, Ren Hui
    Abolinaesumi, Purang
    Stewart, James
    [J]. 2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 714 - 717
  • [9] Standardized evaluation of 2D-3D registration
    van de Kraats, EB
    Penney, GP
    Tomazevic, D
    van Walsum, T
    Niessen, WJ
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2004, PT 1, PROCEEDINGS, 2004, 3216 : 574 - 581
  • [10] Sparse Branch-and-Bound 2D-3D Registration Based on Prior Correspondences of Dense Points
    Pan, Jin
    Min, Zhe
    Shen, Yutian
    Liu, Tingting
    Meng, Max Q-H
    [J]. 2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 151 - 156