6-DoF Pose Estimation and CAD Model Retrieval for XR Interface from a Single RGB Image

被引：0

作者：

Park, Sieun ^{[1
]}

Jeong, Wonje ^{[1
]}

Park, Soon-Yong ^{[1
]}

机构：

[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu, South Korea

来源：

PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年

关键词：

pose estimation; similarity measure; deep learning; AR/XR;

D O I：

10.1145/3656650.3656719

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper proposes a 6-DoF pose estimation and CAD model retrieval for XR interface from a single RGB image. A deep learning network is used to estimate the 6-DoF pose of a real object in an RGB image. Then, several CAD model candidates are rendered and their similarity with the image is measured to decide the final matching CAD model. In the last, the rendered image of the matching CAD model is overlayed with the RGB image. In the experiment, total ten object categories are tested and evaluated using two deep networks.

引用

页数：3

共 50 条

[21] Object 6-DoF pose estimation using auxiliary learning
Chen M.
Gai S.
Da F.
Yu J.
Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (06): : 901 - 914
[22] NEMA: 6-DoF Pose Estimation Dataset for Deep Learning
Roman, Philippe Perez de San
Desbarats, Pascal
Domenger, Jean-Philippe
Buendia, Axel
PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 682 - 690
[23] Robust 6-DoF Pose Estimation under Hybrid Constraints
Ren, Hong
Lin, Lin
Wang, Yanjie
Dong, Xin
SENSORS, 2022, 22 (22)
[24] APE: A MORE PRACTICAL APPROACH TO 6-DOF POSE ESTIMATION
Gabas, Antonio
Yoshiyasu, Yusuke
Singh, Rohan Pratap
Sagawa, Ryusuke
Yoshida, Eiichi
2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 3164 - 3168
[25] Detecting Object Surface Keypoints from a Single RGB Image via Deep Learning Network for 6DoF Pose Estimation
Aing, Lee
Lie, Wen-Nung
2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1673 - 1678
[26] Image Based 6-DOF Camera Pose Estimation with Weighted RANSAC 3D
Wetzel, Johannes
PATTERN RECOGNITION, GCPR 2013, 2013, 8142 : 249 - 254
[27] 6DoF Object Pose and Focal Length Estimation from Single RGB Images in Uncontrolled Environments
Manawadu, Mayura
Park, Soon-Yong
SENSORS, 2024, 24 (17)
[28] Accurate Shape-based 6-DoF Pose Estimation of Single-colored Objects
Azad, Pedram
Asfour, Tamim
Dillmann, Ruediger
2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 2690 - 2695
[29] Cylinder object 6-DOF pose estimation via single perspective circle on cylindrical surface
Yu, Aidi
Wang, Yujia
Guo, Bing
Li, Haoyuan
MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
[30] Real-time 6D pose estimation from a single RGB image
Zhang, Xin
Jiang, Zhiguo
Zhang, Haopeng
IMAGE AND VISION COMPUTING, 2019, 89 : 1 - 11

← 1 2 3 4 5 →