Autonomous multi-drone racing method based on deep reinforcement learning

被引:0
|
作者
Kang, Yu [1 ,2 ,3 ]
Di, Jian [2 ]
Li, Ming [1 ]
Zhao, Yunbo [1 ]
Wang, Yuhui [4 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Adv Technol, Hefei 230088, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei 230088, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
racing drone; autonomous multi-drone racing; sim-to-real; deep reinforcement learning; Markov game;
D O I
10.1007/s11432-023-4029-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Racing drones have attracted increasing attention due to their remarkable high speed and excellent maneuverability. However, autonomous multi-drone racing is quite difficult since it requires quick and agile flight in intricate surroundings and rich drone interaction. To address these issues, we propose a novel autonomous multi-drone racing method based on deep reinforcement learning. A new set of reward functions is proposed to make racing drones learn the racing skills of human experts. Unlike previous methods that required global information about tracks and track boundary constraints, the proposed method requires only limited localized track information within the range of its own onboard sensors. Further, the dynamic response characteristics of racing drones are incorporated into the training environment, so that the proposed method is more in line with the requirements of real drone racing scenarios. In addition, our method has a low computational cost and can meet the requirements of real-time racing. Finally, the effectiveness and superiority of the proposed method are verified by extensive comparison with the state-of-the-art methods in a series of simulations and real-world experiments.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Vision Based Drone Obstacle Avoidance by Deep Reinforcement Learning
    Xue, Zhihan
    Gonsalves, Tad
    AI, 2021, 2 (03) : 366 - 380
  • [32] Challenges and Opportunities of Applying Reinforcement Learning to Autonomous Racing
    Wurman, Peter R.
    Stone, Peter
    Spranger, Michael
    IEEE INTELLIGENT SYSTEMS, 2022, 37 (03) : 20 - 23
  • [33] Distributed deep reinforcement learning for autonomous aerial eVTOL mobility in drone taxi applications
    Yun, Won Joon
    Jung, Soyi
    Kim, Joongheon
    Kim, Jae-Hyun
    ICT EXPRESS, 2021, 7 (01): : 1 - 4
  • [34] Autonomous Single-Image Drone Exploration With Deep Reinforcement Learning and Mixed Reality
    Devo, Alessandro
    Mao, Jeffrey
    Costante, Gabriele
    Loianno, Giuseppe
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 5031 - 5038
  • [35] Deep Reinforcement Learning Based Efficient and Robust Navigation Method For Autonomous Applications
    Hemming, Nathan
    Menon, Vineetha
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 287 - 293
  • [36] AquaFly Project: Autonomous Multi-Drone Water Sampling with a Payload Deployment and Retraction Mechanism
    Massoum, Seyedreza Fattahi
    Feng, Cindi
    Liu, Hugh H. -T.
    UNMANNED SYSTEMS, 2024,
  • [37] A Deep-learning-aided Automatic Vision-based Control Approach for Autonomous Drone Racing in Game of Drones Competition
    Kim, Donghwi
    Ryu, Hyunjee
    Yonchorhor, Jedsadakorn
    Shim, David Hyunchul
    NEURIPS 2019 COMPETITION AND DEMONSTRATION TRACK, VOL 123, 2019, 123 : 37 - 46
  • [38] Deep Reinforcement Learning Tf-Agent-Based Object Tracking With Virtual Autonomous Drone in a Game Engine
    Farkhodov, Khurshedjon
    Lee, Suk-Hwan
    Platos, Jan
    Kwon, Ki-Ryong
    IEEE ACCESS, 2023, 11 : 124129 - 124138
  • [39] Multi-Drone Cooperation for Improved LiDAR-Based Mapping
    Causa, Flavia
    Opromolla, Roberto
    Fasano, Giancarmine
    SENSORS, 2024, 24 (10)
  • [40] A Temporal CNN-based Approach for Autonomous Drone Racing
    Oyuki Rojas-Perez, L.
    Martinez-Carranza, J.
    2019 INTERNATIONAL WORKSHOP ON RESEARCH, EDUCATION AND DEVELOPMENT OF UNMANNED AERIAL SYSTEMS (RED UAS 2019), 2019, : 70 - 77