Learning Agile, Vision-Based Drone Flight: From Simulation to Reality

被引:1
|
作者
Scaramuzza, Davide [1 ]
Kaufmann, Elia [1 ]
机构
[1] Univ Zurich, Zurich, Switzerland
来源
基金
欧洲研究理事会; 瑞士国家科学基金会;
关键词
D O I
10.1007/978-3-031-25555-7_2
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
We present our latest research in learning deep sensorimotor policies for agile, vision-based quadrotor flight. We show methodologies for the successful transfer of such policies from simulation to the real world. In addition, we discuss the open research questions that still need to be answered to improve the agility and robustness of autonomous drones toward human-pilot performance.
引用
收藏
页码:11 / 18
页数:8
相关论文
共 50 条
  • [1] Learning Vision-Based Flight in Drone Swarms by Imitation
    Schilling, Fabian
    Lecoeur, Julien
    Schiano, Fabrizio
    Floreano, Dario
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04) : 4523 - 4530
  • [2] Review of vision-based reinforcement learning for drone navigation
    Aburaya, Anas
    Selamat, Hazlina
    Muslim, Mohd Taufiq
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2024, 8 (04) : 974 - 992
  • [3] Fast and Agile Vision-Based Flight with Teleoperation and Collision Avoidance on a Multirotor
    Spitzer, Alex
    Yang, Xuning
    Yao, John
    Dhawale, Aditya
    Goel, Kshitij
    Dabhi, Mosam
    Collins, Matt
    Boirum, Curtis
    Michael, Nathan
    PROCEEDINGS OF THE 2018 INTERNATIONAL SYMPOSIUM ON EXPERIMENTAL ROBOTICS, 2020, 11 : 524 - 535
  • [4] Agile Formation Control of Drone Flocking Enhanced With Active Vision-Based Relative Localization
    Zhang, Peihan
    Chen, Gang
    Li, Yuzhu
    Dong, Wei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03): : 6359 - 6366
  • [5] Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing
    Fu, Jiawei
    Song, Yunlong
    Wu, Yan
    Yu, Fisher
    Scaramuzza, Davide
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5243 - 5250
  • [6] Vision-Based Drone Flocking in Outdoor Environments
    Schilling, Fabian
    Schiano, Fabrizio
    Floreano, Dario
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 2954 - 2961
  • [7] Vision-based drone flight control and crowd or riot analysis with efficient color histogram based tracking
    Mueller, Thomas
    Mueller, Markus
    AIRBORNE INTELLIGENCE, SURVEILLANCE, RECONNAISSANCE (ISR) SYSTEMS AND APPLICATIONS VIII, 2011, 8020
  • [8] Agilicious: Open-source and open-hardware agile quadrotor for vision-based flight
    Foehn, Philipp
    Kaufmann, Elia
    Romero, Angel
    Penicka, Robert
    Sun, Sihao
    Bauersfeld, Leonard
    Laengle, Thomas
    Cioffi, Giovanni
    Song, Yunlong
    Loquercio, Antonio
    Scaramuzza, Davide
    SCIENCE ROBOTICS, 2022, 7 (67)
  • [9] Vision-based augmented reality system
    Jing, C
    Wang, YT
    Qi, S
    Yan, DY
    THIRD INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND ITS APPLICATION IN INDUSTRY, 2003, 4756 : 17 - 22
  • [10] Quadcopter Drone for Vision-Based Autonomous Target Following
    Chen, Wen-Chieh
    Lin, Chun-Liang
    Chen, Yang-Yi
    Cheng, Hsin-Hsu
    AEROSPACE, 2023, 10 (01)