Robust Sim2Real 3D Object Classification Using Graph Representations and a Deep Center Voting Scheme

被引:2
|
作者
Weibel, Jean-Baptiste [1 ]
Patten, Timothy [1 ,2 ]
Vincze, Markus [1 ]
机构
[1] TU Wien, Vis Robot Lab, Automat & Control Inst, A-1040 Vienna, Austria
[2] Univ Technol Sydney, Fac Engn & Informat Technol, Robot Inst, Ultimo 2007, Australia
基金
欧盟地平线“2020”;
关键词
Deep learning for visual perception; recognition; visual learning;
D O I
10.1109/LRA.2022.3186745
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
While object semantic understanding is essential for service robotic tasks, 3D object classification is still an open problem. Learning from artificial 3D models alleviates the cost of the annotation necessary to approach this problem, but today's methods still struggle with the differences between artificial and real 3D data. We conjecture that one of the causes of this issue is the fact that today's methods learn directly from point coordinates, which makes them highly sensitive to scale changes. We propose to learn from a graph of reproducible object parts whose scale is more reliable. In combination with a voting scheme, our approach achieves significantly more robust classification and improves upon state-of-the-art by up to 16% when transferring from artificial to real objects.
引用
收藏
页码:8028 / 8035
页数:8
相关论文
共 50 条
  • [31] Robust classification of 3D objects using discrete orthogonal moments and deep neural networks
    Lakhili, Zouhir
    El Alami, Abdelmajid
    Mesbah, Abderrahim
    Berrahou, Aissam
    Qjidaa, Hassan
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (27-28) : 18883 - 18907
  • [32] Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors
    Arikumar, K. S.
    Kumar, A. Deepak
    Gadekallu, Thippa Reddy
    Prathiba, Sahaya Beni
    Tamilarasi, K.
    [J]. ELECTRONICS, 2022, 11 (24)
  • [33] 3D object classification using multi-object Kohonen networks
    Corridoni, JM
    DelBimbo, A
    Landi, L
    [J]. PATTERN RECOGNITION, 1996, 29 (06) : 919 - 935
  • [34] Real-Time 3D Visual Sensor for Robust Object Recognition
    Attamimi, Muhammad
    Mizutani, Akira
    Nakamura, Tomoaki
    Nagai, Takayuki
    Funakoshi, Kotaro
    Nakano, Mikio
    [J]. IEEE/RSJ 2010 INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2010), 2010, : 4560 - 4565
  • [35] Flying Through a Narrow Gap Using End-to-End Deep Reinforcement Learning Augmented With Curriculum Learning and Sim2Real
    Xiao, Chenxi
    Lu, Peng
    He, Qizhi
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (05) : 2701 - 2708
  • [36] Towards object classification using 3D sensor data
    Schwertfeger, Soeren
    Poppinga, Jann
    Pfingsthorn, Max
    Birk, Andreas
    [J]. 2008 ECSIS SYMPOSIUM ON LEARNING AND ADAPTIVE BEHAVIORS FOR ROBOTIC SYSTEMS - LAB-RS 2008, PROCEEDINGS, 2008, : 53 - 58
  • [37] S-VoteNet: Deep Hough Voting with Spherical Proposal for 3D Object Detection
    Chen, Yanxian
    Ma, Huimin
    Li, Xi
    Luo, Xiong
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5161 - 5167
  • [38] 3D object feature extraction and classification using 3D MF-DFA
    Wang, Jian
    Han, Ziwei
    Jiang, Wenjing
    Kim, Junseok
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 232
  • [39] 3D Object Classification using 3D Racah Moments Convolutional Neural Networks
    Mesbah, Abderrahim
    Berrahou, Aissam
    El Alami, Abdelmajid
    Berrahou, Nadia
    Berbia, Hassan
    Qjidaa, Hassan
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEMS & SECURITY (NISS19), 2019,
  • [40] Efficient Center Voting for Object Detection and 6D Pose Estimation in 3D Point Cloud
    Guo, Jianwei
    Xing, Xuejun
    Quan, Weize
    Yan, Dong-Ming
    Gu, Qingyi
    Liu, Yang
    Zhang, Xiaopeng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5072 - 5084