A Framework for Real-time Generation of Multi-directional Traversability Maps in Unstructured Environments

被引:0
|
作者
Huang, Tao [1 ]
Wang, Gang [1 ]
Liu, Hongliang [1 ]
Luo, Jun [1 ]
Wu, Lang [1 ]
Zhu, Tao [2 ]
Wang, Shuxin [3 ]
机构
[1] Chongqing Univ, Coll Mech & Vehicle Engn, State Key Lab Mech Transmiss Adv Equipments, Chongqing 400044, Peoples R China
[2] Chongqing Univ, Key Lab Optoelect Technol & Syst, Minist Educ, Chongqing 400044, Peoples R China
[3] Chongqing Univ, State Key Lab Mech Transmiss Adv Equipments, Chongqing 400044, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024) | 2024年
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Foundations of automation; autonomous vehicle navigation; task planning; VISUAL TERRAIN CLASSIFICATION;
D O I
10.1109/ICRA57147.2024.10610312
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In complex unstructured environments, accurate terrain traversability analysis is a fundamental requirement for the successful execution of any movements of ground robots, especially given that terrain traversability often exhibits anisotropy. However, the difficulty in obtaining multi-directional terrain labels hinders the emergence of end-to-end multi-directional traversability network. This paper introduces a framework for real-time multi-directional traversability maps (MTraMap) generation tailored for unstructured environments. It involves pre-training a uni-directional traversability classifier, termed UniTraT, through self-supervised learning using ground robot travel simulation. Furthermore, it employs Uni-directional to Multi-directional Traversability Distillation (UMTraDistill) to distill a multi-directional traversability network, termed MultiTCNN, which is capable of directly generating MTraMap. We evaluated both networks on our traversability dataset, achieving an 89% accuracy in terrain traversability classification with the UniTraT. Compared to UniTraT, the accuracy of the MultiTCNN distilled via UMTraDistill only decreases by 1.8%, and it can process 10 m x 10 m elevation map at a speed of 74 fps. Field robotics experiments were also conducted and showed that MultiTCNN can generate MTraMap of the surrounding 20 m x 20 m environment at a rate of 9.39 fps, with a slight reduction of 0.61 fps compared to the lidar data publishing rate, and the generated MTraMap can clearly delineate the multi-directional traversability of the surrounding environments.
引用
收藏
页码:18370 / 18376
页数:7
相关论文
共 50 条
  • [1] Multi-Directional Structural Dynamic Test using Optimized Real-time Hybrid Control System
    Na, O.
    Kim, S.
    EXPERIMENTAL TECHNIQUES, 2016, 40 (01) : 441 - 452
  • [2] Multi-Directional Structural Dynamic Test using Optimized Real-time Hybrid Control System
    O. Na
    S. Kim
    S. Kim
    Experimental Techniques, 2016, 40 : 441 - 452
  • [3] Multi-directional feature refinement network for real-time semantic segmentation in urban street scenes
    Zhou, Yan
    Zheng, Xihong
    Yang, Yin
    Li, Jianxun
    Mu, Jinzhen
    Irampaye, Richard
    IET COMPUTER VISION, 2023, 17 (04) : 431 - 444
  • [4] Real-Time Effective Framework for Unstructured Data Mining
    Lomotey, Richard K.
    Deters, Ralph
    2013 12TH IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2013), 2013, : 1081 - 1088
  • [5] Development of multi-directional real-time hybrid simulation for tall buildings subject to multi-natural hazards
    Al-Subaihawi, Safwan
    Ricles, James
    Quiel, Spencer
    Marullo, Thomas
    ENGINEERING STRUCTURES, 2024, 315
  • [6] ScaTE: A Scalable Framework for Self- Supervised Traversability Estimation in Unstructured Environments
    Seo, Junwon
    Kim, Taekyung
    Kwak, Kiho
    Min, Jihong
    Shim, Inwook
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 888 - 895
  • [7] Real-time Lane Detection, Fitting and Navigation for Unstructured Environments
    Singhal, Apoorve
    Mohta, Vibhakar
    Jha, Arvind
    Khandelwal, Yash
    Agrawal, Deepank
    Kowshik, Shreyas
    Agarwal, Siddhant
    Shrivastava, Shrey
    Lodhi, Vaibhav
    Chakravarty, Debashish
    2019 INTERNATIONAL CONFERENCE ON IMAGE AND VIDEO PROCESSING, AND ARTIFICIAL INTELLIGENCE, 2019, 11321
  • [8] Towards real-time global localization in dynamic unstructured environments
    Tanaka, Kanji
    Kondo, Eiji
    JSME INTERNATIONAL JOURNAL SERIES C-MECHANICAL SYSTEMS MACHINE ELEMENTS AND MANUFACTURING, 2006, 49 (03) : 905 - 911
  • [9] A Real-Time Multi-Dimensional Visualization Framework For Critical And Complex Environments
    Kamaleswaran, Rishikesan
    McGregor, Carolyn
    2014 IEEE 27TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), 2014, : 325 - 328
  • [10] RUBA: Real-time Unstructured Big Data Analysis Framework
    Kim, Jaein
    Kim, Nacwoo
    Lee, Byungtak
    Park, Joonho
    Seo, Kwangik
    Park, Hunyoung
    2013 INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2013): FUTURE CREATIVE CONVERGENCE TECHNOLOGIES FOR NEW ICT ECOSYSTEMS, 2013, : 520 - 524