RT-less: a multi-scene RGB dataset for 6D pose estimation of reflective texture-less objects

被引:2
|
作者
Zhao, Xinyue [1 ]
Li, Quanzhi [1 ]
Chao, Yue [1 ]
Wang, Quanyou [1 ]
He, Zaixing [1 ]
Liang, Dong [2 ]
机构
[1] Zhejiang Univ, Sch Mech Engn, State Key Lab Fluid Power & Mechatron Syst, Hangzhou 310027, Peoples R China
[2] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210016, Peoples R China
来源
VISUAL COMPUTER | 2024年 / 40卷 / 08期
基金
中国国家自然科学基金;
关键词
Pose estimation; Pose measurement; Object detection; Instance segmentation; Reflective; Texture-less; Machine vision;
D O I
10.1007/s00371-023-03097-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The 6D (6 Degree of freedom) pose estimation (or pose measurement) of machined reflective texture-less objects, which are common in industry, is a significant but challenging technique. It has attracted increasing attention in academia and industry. However, it is difficult to obtain suitable public datasets of such objects, which makes relevant studies inconvenient. Thus, we proposed the Reflective Texture-Less (RT-Less) object dataset, which is a new public dataset of reflective texture-less metal parts for pose estimation research. The dataset contains 38 machined texture-less reflective metal parts in total. Different parts demonstrate the symmetry and similarity of shape and size. The dataset contains 289 K RGB images and the same number of masks, including 25,080 real images, 250,800 synthetic images in the training set, and 13,312 real images captured in 32 different scenes in the test set. The dataset also provides accurate ground truth poses, bounding-box annotations and masks for these images, which makes RT-Less suitable for object detection and instance segmentation. To improve the accuracy of the ground truth, an iterative pose optimization method using only RGB images is proposed. Baselines of the state-of-the-art pose estimation methods are provided for further comparative studies. The dataset and results of baselines are available at: http://www.zju-rtl.cn/RT-Less/.
引用
收藏
页码:5187 / 5200
页数:14
相关论文
共 48 条
  • [1] T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects
    Hodan, Tomas
    Haluza, Pavel
    Obdrzalek, Stepan
    Matas, Jiri
    Lourakis, Manolis
    Zabulis, Xenophon
    [J]. 2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 880 - 888
  • [2] Fast 6D Pose Estimation for Texture-less Objects from a single RGB image
    Muoz, E.
    Konishi, Y.
    Murino, V.
    Del Bue, A.
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2016, : 5623 - 5630
  • [3] Texture-less object detection and 6D pose estimation in RGB-D images
    Zhang, Haoruo
    Cao, Qixin
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 95 : 64 - 79
  • [4] ER-Pose: Learning edge representation for 6D pose estimation of texture-less objects
    Yang, Xu
    Li, Kunbo
    Wang, Jinge
    Fan, Xiumin
    [J]. NEUROCOMPUTING, 2023, 515 : 13 - 25
  • [5] 6D Pose Estimation for Texture-Less Industrial Parts in the Crowd
    Zhou, Dexin
    Chai, Ziqi
    Liu, Chao
    Li, Peng
    Xiong, Zhenhua
    [J]. INTELLIGENT ROBOTICS AND APPLICATIONS, 2020, 12595 : 415 - 428
  • [6] EANet: Edge-Attention 6D Pose Estimation Network for Texture-Less Objects
    Zhang, Yuqi
    Liu, Yuanpeng
    Wu, Qiaoyun
    Zhou, Jun
    Gong, Xiaoxi
    Wang, Jun
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] Detect in RGB, Optimize in Edge: Accurate 6D Pose Estimation for Texture-less Industrial Parts
    Zhang, Haoruo
    Cao, Qixin
    [J]. 2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 3486 - 3492
  • [8] Learning 6D Pose of Texture-less Objects via Multi-scale Dense Relation
    Huang, Junwen
    Bian, Zhenwei
    Shi, Yifei
    Xu, Xin
    Zhang, Hongjia
    Xie, Chenggang
    [J]. 2020 INTERNATIONAL CONFERENCE ON IMAGE, VIDEO PROCESSING AND ARTIFICIAL INTELLIGENCE, 2020, 11584
  • [9] Detection and Fine 3D Pose Estimation of Texture-less Objects in RGB-D Images
    Hodan, Tomas
    Zabulis, Xenophon
    Lourakis, Manolis
    Obdrzalek, Stepan
    Matas, Jiri
    [J]. 2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 4421 - 4428
  • [10] An Improved Algorithm for Detection and Pose Estimation of Texture-Less Objects
    Peng, Jian
    Su, Ya
    [J]. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2021, 25 (02) : 204 - 212