6-DoF Pose Estimation and CAD Model Retrieval for XR Interface from a Single RGB Image

被引：0

作者：

Park, Sieun ^{[1
]}

Jeong, Wonje ^{[1
]}

Park, Soon-Yong ^{[1
]}

机构：

[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu, South Korea

来源：

PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年

关键词：

pose estimation; similarity measure; deep learning; AR/XR;

D O I：

10.1145/3656650.3656719

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper proposes a 6-DoF pose estimation and CAD model retrieval for XR interface from a single RGB image. A deep learning network is used to estimate the 6-DoF pose of a real object in an RGB image. Then, several CAD model candidates are rendered and their similarity with the image is measured to decide the final matching CAD model. In the last, the rendered image of the matching CAD model is overlayed with the RGB image. In the experiment, total ten object categories are tested and evaluated using two deep networks.

引用

下载

页数：3

共 50 条

[1] Estimation of monocular vision 6-DOF pose based on CAD model
Song W.
Zhou Y.
Song, Wei (song_wei@shu.edu.cn), 2016, Chinese Academy of Sciences (24): : 882 - 891
[2] Detecting Object Surface Keypoints From a Single RGB Image via Deep Learning Network for 6-DoF Pose Estimation
Aing, Lee
Lie, Wen-Nung
IEEE ACCESS, 2021, 9 : 77729 - 77741
[3] MonoGraspNet: 6-DoF Grasping with a Single RGB Image
Zhai, Guangyao
Huang, Dianye
Wu, Shun-Cheng
Jung, HyunJun
Di, Yan
Manhardt, Fabian
Tombari, Federico
Navab, Nassir
Busam, Benjamin
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1708 - 1714
[4] B-Pose: Bayesian Deep Network for Camera 6-DoF Pose Estimation From RGB Images
Rekavandi, Aref Miri
Boussaid, Farid
Seghouane, Abd-Krim
Bennamoun, Mohammed
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6747 - 6754
[5] 6DoF Pose Estimation of Transparent Object from a Single RGB-D Image
Xu, Chi
Chen, Jiale
Yao, Mengyang
Zhou, Jun
Zhang, Lijun
Liu, Yi
SENSORS, 2020, 20 (23) : 1 - 19
[6] InstancePose: Fast 6DoF Pose Estimation for Multiple Objects from a Single RGB Image
Aing, Lee
Lie, Wen-Nung
Chiang, Jui-Chiu
Lin, Guo-Shiang
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 2621 - 2630
[7] Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images
Liu, Yuan
Wen, Yilin
Peng, Sida
Lin, Cheng
Long, Xiaoxiao
Komura, Taku
Wang, Wenping
COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 298 - 315
[8] FingertipCubes: An Inexpensive DIY Wearable for 6-DoF per Fingertip Pose Estimation using a Single RGB Camera
Gupta, Ojaswi
Hebbalaguppe, Ramya
SA'18: SIGGRAPH ASIA 2018 POSTERS, 2018,
[9] 6-DOF Pose Estimation from Single Ultrasound Image Using 3D IP Models
Zheng, Bo
Ishikawa, Ryo
Oishi, Takeshi
Takamatsu, Jun
Ikeuchi, Katsushi
2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 812 - +
[10] Evaluation of PoseNet for 6-DOF Underwater Pose Estimation
Nielsen, Mikkel Cornelius
Leonhardsen, Mari Hovem
Schjolberg, Ingrid
OCEANS 2019 MTS/IEEE SEATTLE, 2019,

← 1 2 3 4 5 →