Real-time 3D object proposal generation and classification using limited processing resources

被引:3
|
作者
Li, Xuesong [1 ]
Guivant, Jose [1 ]
Khan, Subhan [1 ]
机构
[1] Univ New South Wales, Sch Mech & Mfg Engn, UNSW Sydney, Sydney, NSW 2052, Australia
关键词
Point cloud segmentation; 3D object detection; Optimization; CNN; URBAN ENVIRONMENTS;
D O I
10.1016/j.robot.2020.103557
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The task of detecting 3D objects is important in various robotic applications. The existing deep learning-based detection techniques have achieved impressive performances. However, these techniques are limited to being run on a graphics processing unit (GPU) in a real-time environment. To achieve real-time 3D object detection with limited computational resources, we propose an efficient detection method based on 3D proposal generation and classification. The proposal generation is based mainly on point segmentation, while proposal classification is performed by a lightweight convolution neural network (CNN). KITTI datasets are then used to validate our method. It takes only 0.082 s for our method to process one point block with one core of the central processing unit (CPU). In addition to efficiency, the experimental results also demonstrate the capability of the proposed method of producing a competitive performance in object recall and classification. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] REAL-TIME 3D OBJECT TRACKING
    STEPHENS, RS
    [J]. IMAGE AND VISION COMPUTING, 1990, 8 (01) : 91 - 96
  • [2] Real-Time Object Classification in 3D Point Clouds Using Point Feature Histograms
    Himmelsbach, M.
    Luettel, T.
    Wuensche, H. -J.
    [J]. 2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, : 994 - 1000
  • [3] Real-Time 3D Object Detection and Classification in Autonomous Driving Environment Using 3D LiDAR and Camera Sensors
    Arikumar, K. S.
    Kumar, A. Deepak
    Gadekallu, Thippa Reddy
    Prathiba, Sahaya Beni
    Tamilarasi, K.
    [J]. ELECTRONICS, 2022, 11 (24)
  • [4] Real-Time 3D Object Detection and Recognition using a Smartphone
    Chen, Jin
    Zhu, Zhigang
    [J]. IMPROVE: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND VISION ENGINEERING, 2022, : 158 - 165
  • [5] Real-Time Complex Object 3D Measurement
    Li, Zhongwei
    Shi, Yusheng
    Wang, Congjun
    [J]. 2009 INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION, PROCEEDINGS, 2009, : 191 - 193
  • [6] REAL-TIME HYPERSPECTRAL STEREO PROCESSING FOR THE GENERATION OF 3D DEPTH INFORMATION
    Heide, Nina
    Frese, Christian
    Emter, Thomas
    Petereit, Janko
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3299 - 3303
  • [7] Processing chain for 3D histogram of gradients based real-time object recognition
    Vilar, Cristian
    Krug, Silvia
    Thornberg, Benny
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2021, 18 (01)
  • [8] Real-time 3D Recognition of Manipulated Object by Robot Hand Using 3D Sensor
    Minowa, Ryo
    Namiki, Akio
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1798 - 1803
  • [9] A REAL-TIME GRID MAP GENERATION AND OBJECT CLASSIFICATION FOR GROUND-BASED 3D LIDAR DATA USING IMAGE ANALYSIS TECHNIQUES
    Lee, Sang-Mook
    Im, Jeong Joon
    Lee, Bo-Hee
    Leonessa, Alexander
    Kurdila, Andrew
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 2253 - 2256
  • [10] High speed 3D scanner with real-time 3D processing
    Lavelle, JP
    Schuet, SR
    Schuet, DJ
    [J]. 2004 IEEE INTERNATIONAL WORKSHOP ON IMAGING SYSTEMS AND TECHNIQUES (IST), 2004, : 13 - 17