6-DoF Pose Estimation and CAD Model Retrieval for XR Interface from a Single RGB Image

被引：0

作者：

Park, Sieun ^{[1
]}

Jeong, Wonje ^{[1
]}

Park, Soon-Yong ^{[1
]}

机构：

[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu, South Korea

来源：

PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年

关键词：

pose estimation; similarity measure; deep learning; AR/XR;

D O I：

10.1145/3656650.3656719

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper proposes a 6-DoF pose estimation and CAD model retrieval for XR interface from a single RGB image. A deep learning network is used to estimate the 6-DoF pose of a real object in an RGB image. Then, several CAD model candidates are rendered and their similarity with the image is measured to decide the final matching CAD model. In the last, the rendered image of the matching CAD model is overlayed with the RGB image. In the experiment, total ten object categories are tested and evaluated using two deep networks.

引用

下载

页数：3

共 50 条

[31] 6-DOF Pose Estimation of a Portable Navigation Aid for the Visually Impaired
Tamjidi, Amirhossein
Ye, Cang
Hong, Soonhac
2013 IEEE INTERNATIONAL SYMPOSIUM ON ROBOTIC AND SENSORS ENVIRONMENTS (ROSE 2013), 2013,
[32] RNNPose: 6-DoF Object Pose Estimation via Recurrent Correspondence Field Estimation and Pose Optimization
Xu, Yan
Lin, Kwan-Yee
Zhang, Guofeng
Wang, Xiaogang
Li, Hongsheng
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (07) : 4669 - 4683
[33] Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation
Li, Yiming
Kong, Tao
Chu, Ruihang
Li, Yifeng
Wang, Peng
Li, Lei
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 3571 - 3578
[34] Hand Pose Estimation from a Single RGB-D Image
Kuznetsova, Alina
Rosenhahn, Bodo
ADVANCES IN VISUAL COMPUTING, PT II, 2013, 8034 : 592 - 602
[35] Triplane Grasping: Efficient 6-DoF Grasping with Single RGB Images
Li, Yiming
Ren, Hanchi
Deng, Jingjing
Xie, Xianghua
arXiv,
[36] CDPN: Coordinates-Based Disentangled Pose Network for Real-Time RGB-Based 6-DoF Object Pose Estimation
Li, Zhigang
Wang, Gu
Ji, Xiangyang
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7677 - 7686
[37] 6D Pose Estimation of Transparent Object From Single RGB Image for Robotic Manipulation
Byambaa, Munkhtulga
Koutaki, Gou
Choimaa, Lodoiravsal
IEEE ACCESS, 2022, 10 : 114897 - 114906
[38] Real-Time and Efficient 6-D Pose Estimation From a Single RGB Image
Cheng, Jun
Liu, Penglei
Zhang, Qieshi
Ma, Hui
Wang, Fei
Zhang, Jin
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[39] 6-DoF Pose Estimation from Stereo LiDAR of Actual Machine using Deep Learning
Hashimoto, Shintaro
Nakajima, Yu
Ishihama, Naoki
2023 IEEE AEROSPACE CONFERENCE, 2023,
[40] End-to-End 6DoF Pose Estimation From Monocular RGB Images
Zou, Wenbin
Wu, Di
Tian, Shishun
Xiang, Canqun
Li, Xia
Zhang, Lu
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2021, 67 (01) : 87 - 96

← 1 2 3 4 5 →