Sim-to-Real RNN-Based Framework for the Precise Positioning of Autonomous Mobile Robots

被引:0
|
作者
Mutti, Stefano [1 ,2 ]
Pedrocchi, Nicola [3 ]
Valente, Anna [2 ]
Dimauro, Giovanni [1 ]
机构
[1] University Of Bari Aldo Moro, Department Of Computer Science, Bari,70121, Italy
[2] Institute Of Systems And Technologies For Sustainable Production, Supsi, East Campus, Lugano,6962, Switzerland
[3] Institute Of Intelligent Industrial Technologies And Systems For Advanced Manufacturing, National Research Council, Milan,20133, Italy
关键词
Mobile robots - Recurrent neural networks - Robot learning - Transfer learning;
D O I
10.1109/ACCESS.2024.3488175
中图分类号
学科分类号
摘要
This work proposes a recurrent neural network-based sim-to-real method to learn mobile robot localization using lidar data in dynamic environments. The main aim of the algorithm is to estimate a Cartesian position error relative to a saved position by means of stored lidar readings in a two-dimensional environment, using lidar data as input. To achieve this, we propose a method that first trains a model on synthetic and augmented LiDAR data to embed rigid transformations into the deep learning model and then fine-tunes the model on real positions using real-world data and external camera measures to produce training labels. This pre-training and fine-tuning approach considerably reduces the time, the computation power, and the amount of real-world data needed to have an accurate model, allowing running the fine-positioning model on the edge of autonomous mobile robots(AMRs). After optimizing the model architecture and hyperparameters, the devised model is tested in different scenarios, comparing the precise positioning capability of AMRs with that of a classical iterative closest point and advanced Monte Carlo localization. © 2013 IEEE.
引用
收藏
页码:163948 / 163957
相关论文
共 50 条
  • [1] Vision-based Collision Avoidance for Mobile Robots through Sim-to-Real Transfer
    Lee, Jin-Woo
    Kim, Keon-Woo
    Shin, Soo-Hyun
    Kim, Seong-Woo
    2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2022,
  • [2] A Sim-to-Real Deep Learning-Based Framework for Autonomous Nano-Drone Racing
    Lamberti, Lorenzo
    Cereda, Elia
    Abbate, Gabriele
    Bellone, Lorenzo
    Morinigo, Victor Javier Kartsch
    Barcis, Michal
    Barcis, Agata
    Giusti, Alessandro
    Conti, Francesco
    Palossi, Daniele
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1899 - 1906
  • [3] Software Framework of Autonomous Mobile Robots on Isaac Sim and ROS
    Jiono, Mahfud
    Lin, Hsien-I
    2023 11TH INTERNATIONAL CONFERENCE ON CONTROL, MECHATRONICS AND AUTOMATION, ICCMA, 2023, : 158 - 163
  • [4] Sim-to-Real of Soft Robots With Learned Residual Physics
    Gao, Junpeng
    Michelis, Mike Y.
    Spielberg, Andrew
    Katzschmann, Robert K.
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (10): : 8523 - 8530
  • [5] Sim-to-Real: Learning Agile Locomotion For Quadruped Robots
    Tan, Jie
    Zhang, Tingnan
    Coumans, Erwin
    Iscen, Atil
    Bai, Yunfei
    Hafner, Danijar
    Bohez, Steven
    Vanhoucke, Vincent
    ROBOTICS: SCIENCE AND SYSTEMS XIV, 2018,
  • [6] Sim-to-Real Autonomous Vehicle Lane Keeping usingVision
    Kocic, Jelena
    Jovicic, Nenad
    2021 29TH TELECOMMUNICATIONS FORUM (TELFOR), 2021,
  • [7] Sim-to-Real Application of Reinforcement Learning Agents for Autonomous, Real Vehicle Drifting
    Toth, Szilard Hunor
    Viharos, Zsolt Janos
    Bardos, Adam
    Szalay, Zsolt
    VEHICLES, 2024, 6 (02): : 781 - 798
  • [8] Low-Resolution Sensing for Sim-to-Real Complex Terrain Robots
    Shepherd, Dexter R.
    Knight, James C.
    TOWARDS AUTONOMOUS ROBOTIC SYSTEMS, TAROS 2023, 2023, 14136 : 190 - 201
  • [9] Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Driving
    Hu, Chuqing
    Hudson, Sinclair
    Ethier, Martin
    Al-Sharman, Mohammad
    Rayside, Derek
    Melek, William
    2022 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2022, : 457 - 463
  • [10] Efficient Jacobian-Based Inverse Kinematics With Sim-to-Real Transfer of Soft Robots by Learning
    Fang, Guoxin
    Tian, Yingjun
    Yang, Zhi-Xin
    Geraedts, Jo M. P.
    Wang, Charlie C. L.
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2022, 27 (06) : 5296 - 5306