A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning

被引:26
|
作者
Hoque, Sabera [1 ]
Arafat, Md. Yasir [1 ]
Xu, Shuxiang [1 ]
Maiti, Ananda [1 ]
Wei, Yuchen [1 ]
机构
[1] Univ Tasmania, Sch Informat & Commun Technol, Newnham, Tas 7248, Australia
关键词
Three-dimensional displays; Object detection; Pose estimation; Laser radar; Cameras; Visualization; Automobiles; Machine learning; deep neural network; computer vision; image processing; convolutional neural network; 3D object detection; 6D pose estimation; NEURAL-NETWORKS; IMAGE FEATURES; RECOGNITION; REPRESENTATION; LOCALIZATION; TRACKING; SEGMENTATION;
D O I
10.1109/ACCESS.2021.3114399
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, computer vision with 3D (dimension) object detection and 6D (degree of freedom) pose assumptions are widely discussed and studied in the field. In the 3D object detection process, classifications are centered on the object's size, position, and direction. And in 6D pose assumptions, networks emphasize 3D translation and rotation vectors. Successful application of these strategies can have a huge impact on various machine learning-based applications, including the autonomous vehicles, the robotics industry, and the augmented reality sector. Although extensive work has been done on 3D object detection with a pose assumption from RGB images, the challenges have not been fully resolved. Our analysis provides a comprehensive review of the proposed contemporary techniques for complete 3D object detection and the recovery of 6D pose assumptions of an object. In this review research paper, we have discussed several proposed sophisticated methods in 3D object detection and 6D pose estimation, including some popular data sets, evaluation matrix, and proposed method challenges. Most importantly, this study makes an effort to offer some possible future directions in 3D object detection and 6D pose estimation. We accept the autonomous vehicle as the sample case for this detailed review. Finally, this review provides a complete overview of the latest in-depth learning-based research studies related to 3D object detection and 6D pose estimation systems and points out a comparison between some popular frameworks. To be more concise, we propose a detailed summary of the state-of-the-art techniques of modern deep learning-based object detection and pose estimation models.
引用
收藏
页码:143746 / 143770
页数:25
相关论文
共 50 条
  • [31] SilhoNet: An RGB Method for 6D Object Pose Estimation
    Billings, Gideon
    Johnson-Roberson, Matthew
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04): : 3727 - 3734
  • [32] On Object Symmetries and 6D Pose Estimation from Images
    Pitteri, Giorgia
    Ramamonjisoa, Michael
    Ilic, Slobodan
    Lepetit, Vincent
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 614 - 622
  • [33] MONO6D: MONOCULAR VEHICLE 6D POSE ESTIMATION WITH 3D PRIORS
    Lyu, Yangxintong
    Royen, Remco
    Munteanu, Adrian
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2187 - 2191
  • [34] Confidence-Based 6D Object Pose Estimation
    Huang, Wei-Lun
    Hung, Chun-Yi
    Lin, I-Chen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3025 - 3035
  • [35] ConvPoseCNN: Dense Convolutional 6D Object Pose Estimation
    Capellen, Catherine
    Schwarz, Max
    Behnke, Sven
    PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 162 - 172
  • [36] Graph neural network for 6D object pose estimation
    Yin, Pengshuai
    Ye, Jiayong
    Lin, Guoshen
    Wu, Qingyao
    KNOWLEDGE-BASED SYSTEMS, 2021, 218
  • [37] Generalizable and Accurate 6D Object Pose Estimation Network
    Fu, Shouxu
    Li, Xiaoning
    Yu, Xiangdong
    Cao, Lu
    Li, Xingxing
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 312 - 324
  • [38] Segmentation-driven 6D Object Pose Estimation
    Hu, Yinlin
    Hugonot, Joachim
    Fua, Pascal
    Salzmann, Mathieu
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3380 - 3389
  • [39] 6D Object Pose Estimation for Robot Programming by Demonstration
    Ghahramani, Mohammad
    Vakanski, Aleksandar
    Janabi-Sharifi, Farrokh
    PROGRESS IN OPTOMECHATRONIC TECHNOLOGIES, 2019, 233 : 93 - 101
  • [40] RobotP: A Benchmark Dataset for 6D Object Pose Estimation
    Yuan, Honglin
    Hoogenkamp, Tim
    Veltkamp, Remco C.
    SENSORS, 2021, 21 (04) : 1 - 26