A Comprehensive Review on 3D Object Detection and 6D Pose Estimation With Deep Learning

被引:26
|
作者
Hoque, Sabera [1 ]
Arafat, Md. Yasir [1 ]
Xu, Shuxiang [1 ]
Maiti, Ananda [1 ]
Wei, Yuchen [1 ]
机构
[1] Univ Tasmania, Sch Informat & Commun Technol, Newnham, Tas 7248, Australia
关键词
Three-dimensional displays; Object detection; Pose estimation; Laser radar; Cameras; Visualization; Automobiles; Machine learning; deep neural network; computer vision; image processing; convolutional neural network; 3D object detection; 6D pose estimation; NEURAL-NETWORKS; IMAGE FEATURES; RECOGNITION; REPRESENTATION; LOCALIZATION; TRACKING; SEGMENTATION;
D O I
10.1109/ACCESS.2021.3114399
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, computer vision with 3D (dimension) object detection and 6D (degree of freedom) pose assumptions are widely discussed and studied in the field. In the 3D object detection process, classifications are centered on the object's size, position, and direction. And in 6D pose assumptions, networks emphasize 3D translation and rotation vectors. Successful application of these strategies can have a huge impact on various machine learning-based applications, including the autonomous vehicles, the robotics industry, and the augmented reality sector. Although extensive work has been done on 3D object detection with a pose assumption from RGB images, the challenges have not been fully resolved. Our analysis provides a comprehensive review of the proposed contemporary techniques for complete 3D object detection and the recovery of 6D pose assumptions of an object. In this review research paper, we have discussed several proposed sophisticated methods in 3D object detection and 6D pose estimation, including some popular data sets, evaluation matrix, and proposed method challenges. Most importantly, this study makes an effort to offer some possible future directions in 3D object detection and 6D pose estimation. We accept the autonomous vehicle as the sample case for this detailed review. Finally, this review provides a complete overview of the latest in-depth learning-based research studies related to 3D object detection and 6D pose estimation systems and points out a comparison between some popular frameworks. To be more concise, we propose a detailed summary of the state-of-the-art techniques of modern deep learning-based object detection and pose estimation models.
引用
收藏
页码:143746 / 143770
页数:25
相关论文
共 50 条
  • [21] Augmented Autoencoders: Implicit 3D Orientation Learning for 6D Object Detection
    Sundermeyer, Martin
    Marton, Zoltan-Csaba
    Durner, Maximilian
    Triebel, Rudolph
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (03) : 714 - 729
  • [22] Deep Quaternion Pose Proposals for 6D Object Pose Tracking
    Majcher, Mateusz
    Kwolek, Bogdan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 243 - 251
  • [23] Learning stereopsis from geometric synthesis for 6D object pose estimation
    State Key Laboratory of Industrial Control Technology and Institue of Cyber-Systems and Control, Zhejiang University, Zhejiang, China
    arXiv, 1600,
  • [24] KDFNet: Learning Keypoint Distance Field for 6D Object Pose Estimation
    Liu, Xingyu
    Iwase, Shun
    Kitani, Kris M.
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 4631 - 4638
  • [25] Active 6D Multi-Object Pose Estimation in Cluttered Scenarios with Deep Reinforcement Learning
    Sock, Juil
    Garcia-Hernando, Guillermo
    Kim, Tae-Kyun
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10564 - 10571
  • [26] Bayesian Optimization of 3D Feature Parameters for 6D Pose Estimation
    Hagelskjaer, Frederik
    Kruger, Norbert
    Buch, Anders
    PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2019, : 135 - 142
  • [27] Deep Learning Frontiers in 3D Object Detection: A Comprehensive Review for Autonomous Driving
    Pravallika, Ambati
    Hashmi, Mohammad Farukh
    Gupta, Aditya
    IEEE Access, 2024, 12 : 173936 - 173980
  • [28] Research on Model-Free 6D Object Pose Estimation Based on Vision 3D Matching
    Chen, Yan
    Yi, Pengfei
    Guo, Yujie
    Liu, Rui
    Dong, Jing
    Zhou, Dongsheng
    2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [29] 6D Object Pose Estimation using Few-Shot Instance Segmentation and 3D Matching
    Li, Wanyi
    Sun, Jia
    Luo, Yongkang
    Wang, Peng
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 1071 - 1077
  • [30] A Probabilistic Framework for Stereo-Vision Based 3D Object Search with 6D Pose Estimation
    Ma, Jeremy
    Burdick, Joel W.
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 2036 - 2042