A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning

被引:26
|
作者
Hoque, Sabera [1 ]
Arafat, Md. Yasir [1 ]
Xu, Shuxiang [1 ]
Maiti, Ananda [1 ]
Wei, Yuchen [1 ]
机构
[1] Univ Tasmania, Sch Informat & Commun Technol, Newnham, Tas 7248, Australia
关键词
Three-dimensional displays; Object detection; Pose estimation; Laser radar; Cameras; Visualization; Automobiles; Machine learning; deep neural network; computer vision; image processing; convolutional neural network; 3D object detection; 6D pose estimation; NEURAL-NETWORKS; IMAGE FEATURES; RECOGNITION; REPRESENTATION; LOCALIZATION; TRACKING; SEGMENTATION;
D O I
10.1109/ACCESS.2021.3114399
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, computer vision with 3D (dimension) object detection and 6D (degree of freedom) pose assumptions are widely discussed and studied in the field. In the 3D object detection process, classifications are centered on the object's size, position, and direction. And in 6D pose assumptions, networks emphasize 3D translation and rotation vectors. Successful application of these strategies can have a huge impact on various machine learning-based applications, including the autonomous vehicles, the robotics industry, and the augmented reality sector. Although extensive work has been done on 3D object detection with a pose assumption from RGB images, the challenges have not been fully resolved. Our analysis provides a comprehensive review of the proposed contemporary techniques for complete 3D object detection and the recovery of 6D pose assumptions of an object. In this review research paper, we have discussed several proposed sophisticated methods in 3D object detection and 6D pose estimation, including some popular data sets, evaluation matrix, and proposed method challenges. Most importantly, this study makes an effort to offer some possible future directions in 3D object detection and 6D pose estimation. We accept the autonomous vehicle as the sample case for this detailed review. Finally, this review provides a complete overview of the latest in-depth learning-based research studies related to 3D object detection and 6D pose estimation systems and points out a comparison between some popular frameworks. To be more concise, we propose a detailed summary of the state-of-the-art techniques of modern deep learning-based object detection and pose estimation models.
引用
收藏
页码:143746 / 143770
页数:25
相关论文
共 50 条
  • [41] 6D Object Pose Estimation Based on the Attention Mechanism
    Zhou, Guanyu
    INTERNATIONAL CONFERENCE ON ALGORITHMS, HIGH PERFORMANCE COMPUTING, AND ARTIFICIAL INTELLIGENCE (AHPCAI 2021), 2021, 12156
  • [42] Focal segmentation for robust 6D object pose estimation
    Ye, Yuning
    Park, Hanhoon
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 47563 - 47585
  • [43] Sparse Keypoint Models for 6D Object Pose Estimation
    Sadran, Emal
    Wurm, Kai M.
    Burschka, Darius
    2013 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2013), 2013, : 307 - 312
  • [44] Focal segmentation for robust 6D object pose estimation
    Yuning Ye
    Hanhoon Park
    Multimedia Tools and Applications, 2024, 83 : 47563 - 47585
  • [45] Single-Stage 6D Object Pose Estimation
    Hu, Yinlin
    Fua, Pascal
    Wang, Wei
    Salzmann, Mathieu
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2927 - 2936
  • [46] DoPose-6D dataset for object segmentation and 6D pose estimation
    Gouda, Anas
    Ghanem, Abraham
    Reining, Christopher
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 477 - 483
  • [47] Anchor-Based 6D Object Pose Estimation
    Liu, Zehao
    Wang, Hao
    Liu, Fuchang
    2021 IEEE 7TH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY (ICVR 2021), 2021, : 33 - 40
  • [48] Global Hypothesis Generation for 6D Object Pose Estimation
    Michel, Frank
    Kirillov, Alexander
    Brachmann, Eric
    Krull, Alexander
    Gumhold, Stefan
    Savchynskyy, Bogdan
    Rother, Carsten
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 115 - 124
  • [49] 6D pose estimation and 3D object reconstruction from 2D shape for robotic grasping of objects
    Wolnitza, Marcell
    Kaya, Osman
    Kulvicius, Tomas
    Woergoetter, Florentin
    Dellen, Babette
    2022 SIXTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING, IRC, 2022, : 67 - 71
  • [50] MagicCubePose, A more comprehensive 6D pose estimation network
    Fudong Li
    Dongyang Gao
    Qiang Huang
    Wei Li
    Yuequan Yang
    Scientific Reports, 13