Robust Sim2Real 3D Object Classification Using Graph Representations and a Deep Center Voting Scheme

被引:2
|
作者
Weibel, Jean-Baptiste [1 ]
Patten, Timothy [1 ,2 ]
Vincze, Markus [1 ]
机构
[1] TU Wien, Vis Robot Lab, Automat & Control Inst, A-1040 Vienna, Austria
[2] Univ Technol Sydney, Fac Engn & Informat Technol, Robot Inst, Ultimo 2007, Australia
基金
欧盟地平线“2020”;
关键词
Deep learning for visual perception; recognition; visual learning;
D O I
10.1109/LRA.2022.3186745
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
While object semantic understanding is essential for service robotic tasks, 3D object classification is still an open problem. Learning from artificial 3D models alleviates the cost of the annotation necessary to approach this problem, but today's methods still struggle with the differences between artificial and real 3D data. We conjecture that one of the causes of this issue is the fact that today's methods learn directly from point coordinates, which makes them highly sensitive to scale changes. We propose to learn from a graph of reproducible object parts whose scale is more reliable. In combination with a voting scheme, our approach achieves significantly more robust classification and improves upon state-of-the-art by up to 16% when transferring from artificial to real objects.
引用
收藏
页码:8028 / 8035
页数:8
相关论文
共 50 条
  • [41] Real-Time Object Classification in 3D Point Clouds Using Point Feature Histograms
    Himmelsbach, M.
    Luettel, T.
    Wuensche, H. -J.
    [J]. 2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 994 - 1000
  • [42] Real-time 3D object proposal generation and classification using limited processing resources
    Li, Xuesong
    Guivant, Jose
    Khan, Subhan
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2020, 130
  • [43] FAST 2D-TO-3D NIATCHING WITH CAMERA POSE VOTING FOR 3D OBJECT IDENTIFICATION
    Bao, Inhan
    Iwamoto, Kota
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 664 - 668
  • [44] Robust elastic 2D/3D geometric graph matching
    Serradell, Eduard
    Kybic, Jan
    Moreno-Noguer, Francesc
    Fua, Pascal
    [J]. MEDICAL IMAGING 2012: IMAGE PROCESSING, 2012, 8314
  • [45] 3D Object Recognition Using X3D and Deep Learning
    Kim, Ha-Seong
    Lee, Myeong Won
    [J]. PROCEEDINGS OF THE 25TH ACM CONFERENCE ON 3D WEB TECHNOLOGY, WEB3D 2020, 2020,
  • [46] Robust 3D Object Tracking Using an Elaborate Motion Model
    Seo, Byung-Kuk
    Wuest, Harald
    [J]. ADJUNCT PROCEEDINGS OF THE 2016 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), 2016, : 70 - 71
  • [47] Continuous medial representations for geometric object modeling in 2D and 3D
    Yushkevich, P
    Fletcher, PT
    Joshi, S
    Thall, A
    Pizer, SM
    [J]. IMAGE AND VISION COMPUTING, 2003, 21 (01) : 17 - 27
  • [48] MeshPointNet: 3D Surface Classification Using Graph Neural Networks and Conformal Predictions on Mesh-Based Representations
    Nobari, Amin Heyrani
    Rey, Justin
    Kodali, Suhas
    Jones, Matthew
    Ahmed, Faez
    [J]. JOURNAL OF MECHANICAL DESIGN, 2024, 146 (05)
  • [49] 3D Convolutional Object Recognition using Volumetric Representations of Depth Data
    Caglayan, Ali
    Can, Ahmet Burak
    [J]. PROCEEDINGS OF THE FIFTEENTH IAPR INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS - MVA2017, 2017, : 125 - 128
  • [50] Real-time robust 3D object tracking and estimation for surveillance system
    Park, Jin-hyung
    Rho, Seungmin
    Jeong, Chang-sung
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2014, 7 (10) : 1599 - 1611