6D object pose estimation via viewpoint relation reasoning

被引:16
|
作者
Zhao, Wanqing [1 ]
Zhang, Shaobo [1 ]
Guan, Ziyu [1 ]
Luo, Hangzai [1 ]
Tang, Lei [2 ]
Peng, Jinye [1 ]
Fan, Jianping [3 ]
机构
[1] Northwestern Univ, Sch Informat & Technol, Xian, Shaanxi, Peoples R China
[2] Xian Microelect Technol Inst, Xian, Shaanxi, Peoples R China
[3] UNC Charlotte, Dept Comp Sci, Charlotte, NC USA
基金
美国国家科学基金会; 国家重点研发计划;
关键词
6D object pose estimation; Keypoints detection; Convolutional neural networks; Geometric reasoning;
D O I
10.1016/j.neucom.2019.12.108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Estimating the 6D object pose is a very challenging task in computer vision. The main difficulty is mapping the object from RGB images to 3D space. In this paper, we present a novel two-stage method for estimating the 6D object pose by using the 2D keypoints of an object and its 2D bounding box. There are two stages in our method. The first stage detects the 2D keypoints and 2D bounding boxes of objects by a stable end-to-end framework. During the training phase, this framework uses viewpoint transformation information and object saliency regions to learn geometrically and semantically consistent keypoints. Then the 6D poses of objects are calculated by a series of geometric reasoning algorithms in the second stage. Experiments show that our method achieves accurate pose estimation and robust to occluded and cluttered scenes. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 50 条
  • [31] DoPose-6D dataset for object segmentation and 6D pose estimation
    Gouda, Anas
    Ghanem, Abraham
    Reining, Christopher
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 477 - 483
  • [32] FAST OBJECT RECOGNITION AND 6D POSE ESTIMATION USING VIEWPOINT ORIENTED COLOR-SHAPE HISTOGRAM
    Wang, Wei
    Chen, Lili
    Chen, Dongming
    Li, Shile
    Kuehnlenz, Kolja
    2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2013), 2013,
  • [33] PoseAgent: Budget-Constrained 6D Object Pose Estimation via Reinforcement Learning
    Krull, Alexander
    Brachmann, Eric
    Nowozin, Sebastian
    Michel, Frank
    Shotton, Jamie
    Rother, Carsten
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2566 - 2574
  • [34] DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion
    Wang, Chen
    Xu, Danfei
    Zhu, Yuke
    Martin-Martin, Roberto
    Lu, Cewu
    Li Fei-Fei
    Savarese, Silvio
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3338 - 3347
  • [35] 6D Object Pose Estimation with Pairwise Compatible Geometric Features
    Lin, Muyuan
    Murali, Varun
    Karaman, Sertac
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 10966 - 10973
  • [36] Temporally Consistent Object 6D Pose Estimation for Robot Control
    Zorina, Kateryna
    Priban, Vojtech
    Fourmy, Mederic
    Sivic, Josef
    Petrik, Vladimir
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 56 - 63
  • [37] Selective Embedding with Gated Fusion for 6D Object Pose Estimation
    Shantong Sun
    Rongke Liu
    Qiuchen Du
    Shuqiao Sun
    Neural Processing Letters, 2020, 51 : 2417 - 2436
  • [38] 6D Object Pose Estimation With Color/Geometry Attention Fusion
    Yuan, Honglin
    Veltkamp, Remco C.
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 529 - 535
  • [39] Hybrid 6D Object Pose Estimation from the RGB Image
    Staszak, Rafal
    Belter, Dominik
    ICINCO: PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON INFORMATICS IN CONTROL, AUTOMATION AND ROBOTICS, VOL 1, 2019, : 541 - 549
  • [40] Rigidity-Aware Detection for 6D Object Pose Estimation
    Hai, Yang
    Song, Rui
    Li, Jiaojiao
    Salzmann, Mathieu
    Hu, Yinlin
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8927 - 8936