A fast object registration method for augmented reality assembly with simultaneous determination of multiple 2D-3D correspondences

被引:30
|
作者
Wang, Ke [1 ]
Liu, Daxin [1 ]
Liu, Zhenyu [1 ]
Duan, Guifang [1 ]
Hu, Liang [1 ]
Tan, Jianrong [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Augmented reality; Registration; Pose estimation; Monocular image; Geometric feature; Assembly guidance; POSE ESTIMATION; VISUAL TRACKING; VISUALIZATION; LOCALIZATION; RECOGNITION;
D O I
10.1016/j.rcim.2019.101890
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A fast and robust object registration is one of the fundamental steps of an augmented reality (AR) assembly guidance system. To manage the registration of texture-less objects from monocular images, this paper presents a three-dimensional (3D) object registration solution in the view-based framework, which incorporates a new image feature named as chain-of-lines feature (COLF). The COLF, constructed by several directed line segments with geometric constraints, enhances the robustness of the registration by establishing multiple correspondences between the two-dimensional (2D) image and 3D model simultaneously. In order to save on computational cost and improve the efficiency of the COLF-based registration, a compression algorithm based on the local breadth-first search (LBFS) strategy is also proposed; this adaptively reduces the number of keyframes according to the target model. In the experimental evaluation, the combination of COLF and LBFS-based keyframe compression shows higher registration success rate and faster speed in comparison with conventional registration methods. Moreover, an AR assembly guidance prototype system for reductors is introduced to illustrate the application of the proposed registration method.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] 2D-3D REGISTRATION OF DEFORMABLE SHAPES WITH MANIFOLD PROJECTION
    Del Bue, Alessio
    Stosic, Marko
    Dodig, Marija
    Xavier, Joao
    [J]. 2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 1061 - +
  • [32] A Saliency-based Framework for 2D-3D Registration
    Brown, Mark
    Guillemaut, Jean-Yves
    Windridge, David
    [J]. PROCEEDINGS OF THE 2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS (VISAPP), VOL 1, 2014, : 265 - 273
  • [33] 2D-3D registration for interventional procedures: A clinical perspective
    Klingenbeck, K
    [J]. BIOMEDICAL IMAGE REGISTRATION, 2003, 2717 : 212 - 213
  • [34] STENT GRAFT REMOVAL FOR IMPROVING 2D-3D REGISTRATION
    Baust, Maximilian
    Demirci, Stefanie
    Navab, Nassir
    [J]. 2009 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1 AND 2, 2009, : 1203 - 1206
  • [35] KTN: Knowledge Transfer Network for Learning Multiperson 2D-3D Correspondences
    Wang, Xuanhan
    Gao, Lianli
    Zhou, Yixuan
    Song, Jingkuan
    Wang, Meng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7732 - 7745
  • [36] Computer assisted determination of acetabular cup orientation using 2D-3D image registration
    Zheng, Guoyan
    Zhang, Xuan
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2010, 5 (05) : 437 - 447
  • [37] A fast, accurate, and automatic 2D-3D image registration for image-guided cranial radiosurgery
    Fu, Dongshan
    Kuduvalli, Gopinath
    [J]. MEDICAL PHYSICS, 2008, 35 (05) : 2180 - 2194
  • [38] A Hybrid 2D-3D Tangible Interface for Virtual Reality
    Zhang, Li
    He, Weiping
    Bai, Huidong
    He, Jun
    Qiao, Yiyue
    Billinghurst, Mark
    [J]. SIGGRAPH '21: ACM SIGGRAPH 2021 POSTERS, 2021,
  • [39] An Automatic Marker-Object Offset Calibration Method for Precise 3D Augmented Reality Registration in Industrial Applications
    Yin, Xuyue
    Fan, Xiumin
    Yang, Xu
    Qiu, Shiguang
    Zhang, Zhinan
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (20):
  • [40] Clinically validating a 2D-3D image registration method to detect patient positioning errors
    Mu, G.
    Lee, B.
    Khamene, A.
    Celi, J.
    Aubin, M.
    Pouliot, J.
    Xia, P.
    [J]. INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2006, 66 (03): : S652 - S652