A Framework for Real-time Generation of Multi-directional Traversability Maps in Unstructured Environments

被引:0
|
作者
Huang, Tao [1 ]
Wang, Gang [1 ]
Liu, Hongliang [1 ]
Luo, Jun [1 ]
Wu, Lang [1 ]
Zhu, Tao [2 ]
Wang, Shuxin [3 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss Adv Equipments, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Key Lab Optoelect Technol & Syst, Minist Educ, Chongqing 400044, Peoples R China
[3] Chongqing Univ, State Key Lab Mech Transmiss Adv Equipments, Chongqing 400044, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024) | 2024年
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Foundations of automation; autonomous vehicle navigation; task planning; VISUAL TERRAIN CLASSIFICATION;
D O I
10.1109/ICRA57147.2024.10610312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex unstructured environments, accurate terrain traversability analysis is a fundamental requirement for the successful execution of any movements of ground robots, especially given that terrain traversability often exhibits anisotropy. However, the difficulty in obtaining multi-directional terrain labels hinders the emergence of end-to-end multi-directional traversability network. This paper introduces a framework for real-time multi-directional traversability maps (MTraMap) generation tailored for unstructured environments. It involves pre-training a uni-directional traversability classifier, termed UniTraT, through self-supervised learning using ground robot travel simulation. Furthermore, it employs Uni-directional to Multi-directional Traversability Distillation (UMTraDistill) to distill a multi-directional traversability network, termed MultiTCNN, which is capable of directly generating MTraMap. We evaluated both networks on our traversability dataset, achieving an 89% accuracy in terrain traversability classification with the UniTraT. Compared to UniTraT, the accuracy of the MultiTCNN distilled via UMTraDistill only decreases by 1.8%, and it can process 10 m x 10 m elevation map at a speed of 74 fps. Field robotics experiments were also conducted and showed that MultiTCNN can generate MTraMap of the surrounding 20 m x 20 m environment at a rate of 9.39 fps, with a slight reduction of 0.61 fps compared to the lidar data publishing rate, and the generated MTraMap can clearly delineate the multi-directional traversability of the surrounding environments.
引用
收藏
页码:18370 / 18376
页数:7
相关论文
共 50 条
  • [21] Adaptive Real-Time Interfaces for Wheelchair-Mounted Manipulators in Unstructured Environments
    Ramirez, D.
    Foulds, R.
    2010 IEEE 36TH ANNUAL NORTHEAST BIOENGINEERING CONFERENCE, 2010,
  • [22] Real-time Quadrotor Navigation Through Planning in Depth Space in Unstructured Environments
    Ahmad, Shakeeb
    Fierro, Rafael
    2019 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS' 19), 2019, : 1467 - 1476
  • [23] Real-time generation of topic maps from speech streams
    Böhm, K
    Maicher, L
    CHARTING THE TOPIC MAPS RESEARCH AND APPLICATIONS LANDSCAPE, 2006, 3873 : 112 - 124
  • [24] Dynamic Hilbert Maps: Real-Time Occupancy Predictions in Changing Environments
    Guizilini, Vitor
    Senanayake, Ransalu
    Ramos, Fabio
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 4091 - 4097
  • [25] Real-time multi-directional flow MRI using model-based reconstructions of undersampled radial FLASH - A feasibility study
    Kollmeier, Jost M.
    Tan, Zhengguo
    Joseph, Arun A.
    Kalentev, Oleksandr
    Voit, Dirk
    Merboldt, K. Dietmar
    Frahm, Jens
    NMR IN BIOMEDICINE, 2019, 32 (12)
  • [26] An Extensible Framework for Real-time Task Generation and Simulation
    Belwal, Chaitanya
    Cheng, Albert M. K.
    2011 IEEE 17TH INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS (RTCSA 2011), VOL 1, 2011, : 259 - 263
  • [27] A test generation framework for quiescent real-time systems
    Briones, LB
    Brinksma, E
    FORMAL APPROACHES TO SOFTWARE TESTING, 2005, 3395 : 64 - 78
  • [28] Unconditionally Stable Central Difference Dissipative Algorithm for Multi-Directional Real-Time Hybrid Simulations of Large Nonlinear Structural Systems
    Al-Subaihawi, Safwan
    Ricles, James M.
    Quiel, Spencer E.
    Marullo, Thomas
    JOURNAL OF EARTHQUAKE ENGINEERING, 2024, 28 (11) : 3256 - 3290
  • [29] Automatic framework generation for hard real-time applications
    Irfan Hamid
    Bechir Zalila
    Elie Najm
    Jérôme Hugues
    Innovations in Systems and Software Engineering, 2008, 4 (1) : 107 - 122
  • [30] Action recognition using multi-directional projected depth motion maps
    Satyamurthi S.
    Tian J.
    Chua M.C.H.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (11) : 14767 - 14773