3D Perception With Slanted Stixels on GPU

被引:0
|
作者
Hernandez-Juarez, Daniel [1 ]
Espinosa, Antonio [2 ]
Vazquez, David [4 ]
Lopez, Antonio M. [3 ,5 ]
Moure, Juan C. [3 ]
机构
[1] SLAMcore Ltd, London SE1 1JA, England
[2] Univ Autonoma Barcelona, Comp Architecture & Operating Syst Dept, Bellaterra 08193, Spain
[3] Univ Autonoma Barcelona, Bellaterra 08193, Spain
[4] Element AI, Montreal, PQ H2S 3G9, Canada
[5] Univ Autonoma Barcelona, Comp Vis Ctr, Bellaterra 08193, Spain
关键词
Graphics processing units; Semantics; Computational modeling; Real-time systems; Mathematical model; Image segmentation; Indexes; Stereo vision; stixel world; autonomous vehicles; scene understanding; computer vision; embedded systems; GPU acceleration;
D O I
10.1109/TPDS.2021.3067836
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This article presents a GPU-accelerated software design of the recently proposed model of Slanted Stixels, which represents the geometric and semantic information of a scene in a compact and accurate way. We reformulate the measurement depth model to reduce the computational complexity of the algorithm, relying on the confidence of the depth estimation and the identification of invalid values to handle outliers. The proposed massively parallel scheme and data layout for the irregular computation pattern that corresponds to a Dynamic Programming paradigm is described and carefully analyzed in performance terms. Performance is shown to scale gracefully on current generation embedded GPUs. We assess the proposed methods in terms of semantic and geometric accuracy as well as run-time performance on three publicly available benchmark datasets. Our approach achieves real-time performance with high accuracy for 2048 x 1024 image sizes and 4 x 4 Stixel resolution on the low-power embedded GPU of an NVIDIA Tegra Xavier.
引用
收藏
页码:2434 / 2447
页数:14
相关论文
共 50 条
  • [21] Comics Stylizations of 3D Scenes Using GPU
    Suarez, Jordane
    Belhadj, Fares
    Boyer, Vincent
    [J]. ADVANCES IN VISUAL COMPUTING, PT III, 2010, 6455 : 524 - 533
  • [22] Human perception of 3D shapes
    Pizlo, Zygmunt
    [J]. COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PROCEEDINGS, 2007, 4673 : 1 - 12
  • [23] TACTILE PERCEPTION IN 3D GEOMETRY
    Jirotkova, Darina
    Littler, Graham
    [J]. PME 30: PROCEEDINGS OF THE 30TH CONFERENCE OF THE INTERNATIONAL GROUP FOR THE PSYCHOLOGY OF MATHEMATICS EDUCATION, VOL 1,, 2006, : 264 - 264
  • [24] THE PERCEPTION OF LOCAL 3D SHAPE
    PHILLIPS, F
    TODD, JT
    NORMAN, JF
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1994, 35 (04) : 1627 - 1627
  • [25] The visual perception of 3D shape
    Todd, JT
    [J]. TRENDS IN COGNITIVE SCIENCES, 2004, 8 (03) : 115 - 121
  • [26] GPU accelerated 3D face registration/recognition
    Abate, Andrea Francesco
    Nappi, Michele
    Ricciardi, Stefano
    Sabatino, Gabriele
    [J]. ADVANCES IN BIOMETRICS, PROCEEDINGS, 2007, 4642 : 938 - +
  • [27] GFT: GPU Fast Triangulation of 3D Points
    Sanchez, Jairo R.
    Alvarez, Hugo
    Borro, Diego
    [J]. COMPUTER VISION AND GRAPHICS, PT II, 2010, 6375 : 235 - +
  • [28] A CPU-GPU Hybrid System of Environment Perception and 3D Terrain Reconstruction for Unmanned Ground Vehicle
    Song, Wei
    Zou, Shuanghui
    Tian, Yifei
    Sun, Su
    Fong, Simon
    Cho, Kyungeun
    Qiu, Lvyang
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2018, 14 (06): : 1445 - 1456
  • [29] Simplification of Moving 3D Scene Data on GPU
    Chenchu, Rajesh
    Michiels, Nick
    Rogmans, Sammy
    Bekaert, Philippe
    [J]. SIGMAP: PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON E-BUSINESS AND TELECOMMUNICATIONS - VOL. 5, 2016, : 95 - 98
  • [30] A GPU 3D Segmentation Framework for Medical Imaging
    Galluzzo, Francesca
    De Marchi, Luca
    Testoni, Nicola
    Masetti, Guido
    [J]. APPLICATIONS IN ELECTRONICS PERVADING INDUSTRY, ENVIRONMENT AND SOCIETY, APPLEPIES 2014, 2016, 351 : 107 - 114