3D Perception With Slanted Stixels on GPU

被引:0
|
作者
Hernandez-Juarez, Daniel [1 ]
Espinosa, Antonio [2 ]
Vazquez, David [4 ]
Lopez, Antonio M. [3 ,5 ]
Moure, Juan C. [3 ]
机构
[1] SLAMcore Ltd, London SE1 1JA, England
[2] Univ Autonoma Barcelona, Comp Architecture & Operating Syst Dept, Bellaterra 08193, Spain
[3] Univ Autonoma Barcelona, Bellaterra 08193, Spain
[4] Element AI, Montreal, PQ H2S 3G9, Canada
[5] Univ Autonoma Barcelona, Comp Vis Ctr, Bellaterra 08193, Spain
关键词
Graphics processing units; Semantics; Computational modeling; Real-time systems; Mathematical model; Image segmentation; Indexes; Stereo vision; stixel world; autonomous vehicles; scene understanding; computer vision; embedded systems; GPU acceleration;
D O I
10.1109/TPDS.2021.3067836
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This article presents a GPU-accelerated software design of the recently proposed model of Slanted Stixels, which represents the geometric and semantic information of a scene in a compact and accurate way. We reformulate the measurement depth model to reduce the computational complexity of the algorithm, relying on the confidence of the depth estimation and the identification of invalid values to handle outliers. The proposed massively parallel scheme and data layout for the irregular computation pattern that corresponds to a Dynamic Programming paradigm is described and carefully analyzed in performance terms. Performance is shown to scale gracefully on current generation embedded GPUs. We assess the proposed methods in terms of semantic and geometric accuracy as well as run-time performance on three publicly available benchmark datasets. Our approach achieves real-time performance with high accuracy for 2048 x 1024 image sizes and 4 x 4 Stixel resolution on the low-power embedded GPU of an NVIDIA Tegra Xavier.
引用
收藏
页码:2434 / 2447
页数:14
相关论文
共 50 条
  • [1] Slanted Stixels: A Way to Represent Steep Streets
    Hernandez-Juarez, Daniel
    Schneider, Lukas
    Cebrian, Pau
    Espinosa, Antonio
    Vazquez, David
    Lopez, Antonio M.
    Franke, Uwe
    Pollefeys, Marc
    Moure, Juan C.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (11-12) : 1643 - 1658
  • [2] Slanted Stixels: A Way to Represent Steep Streets
    Daniel Hernandez-Juarez
    Lukas Schneider
    Pau Cebrian
    Antonio Espinosa
    David Vazquez
    Antonio M. López
    Uwe Franke
    Marc Pollefeys
    Juan C. Moure
    [J]. International Journal of Computer Vision, 2019, 127 : 1643 - 1658
  • [3] Slanted 3D Plasmonic Antenna Arrays
    Zilio, Pierfrancesco
    Malerba, Mario
    Toma, Andrea
    De Angelis, Francesco
    [J]. 2015 CONFERENCE ON LASERS AND ELECTRO-OPTICS (CLEO), 2015,
  • [4] GPU-Accelerated 3D Polygon Visibility Volumes for Synergistic Perception and Navigation
    Willis, Andrew
    Hague, Collin
    Wolek, Artur
    Brink, Kevin
    [J]. SOUTHEASTCON 2024, 2024, : 546 - 551
  • [5] A laminar cortical model for 3D perception of slanted and curved surfaces and of 2D images: development, attention, and bistability
    Grossberg, S
    Swaminathan, G
    [J]. VISION RESEARCH, 2004, 44 (11) : 1147 - 1187
  • [6] Determining depth of field for slanted lenticular 3D displays
    Surman, Phil
    Zheng, Changxiong
    Zhang, Chaojian
    Yao, Zhenwei
    Yang, Xiaochuan
    Xu, Wenwei
    Sun, Xiao Wei
    [J]. OPTICS CONTINUUM, 2023, 2 (09): : 1929 - 1940
  • [7] Increasing Depth of Field for Slanted Lenticular 3D Displays
    Zheng, Changxiong
    Surman, Philip
    Sun, Xiao Wei
    [J]. THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2024, 2024, 13041
  • [8] Optimal 3D Printing Direction for Stability of Slanted Shapes
    Park, Jiyoung
    Shin, Hwa Seon
    [J]. ADVANCES IN COMPUTER SCIENCE AND UBIQUITOUS COMPUTING, 2017, 421 : 613 - 618
  • [9] Perception of 3D spatial relations for 3D displays
    Rosen, P
    Pizlo, Z
    Hoffmann, C
    Popescu, V
    [J]. STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS XI, 2004, 5291 : 9 - 16
  • [10] 3D SHAPE PERCEPTION
    SALACHGOLYSKA, M
    PIZLO, Z
    VYAIN, S
    STANDISH, J
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 1993, 34 (04) : 1083 - 1083