Multi-Task Reinforcement Learning for Quadrotors

被引:0
|
作者
Xing, Jiaxu [1 ,2 ,3 ]
Geles, Ismail [1 ,2 ,3 ]
Song, Yunlong [1 ,2 ,3 ]
Aljalbout, Elie [1 ,2 ,3 ]
Scaramuzza, Davide [1 ,2 ,3 ]
机构
[1] Univ Zurich, Dept Informat, Robot & Percept Grp, CH-8006 Zurich, Switzerland
[2] Univ Zurich, Dept Neuroinformat, CH-8006 Zurich, Switzerland
[3] Swiss Fed Inst Technol, CH-8006 Zurich, Switzerland
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2025年 / 10卷 / 03期
基金
欧洲研究理事会;
关键词
Reinforcement learning; machine learning for robot control; aerial systems: perception and autonomy;
D O I
10.1109/LRA.2024.3520894
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with novel tasks, requiring a complete retraining of the policy from scratch. To address this limitation, this paper presents a novel multi-task reinforcement learning (MTRL) framework tailored for quadrotor control, leveraging the shared physical dynamics of the platform to enhance sample efficiency and task performance. By employing a multi-critic architecture and shared task encoders, our framework facilitates knowledge transfer across tasks, enabling a single policy to execute diverse maneuvers, including high-speed stabilization, velocity tracking, and autonomous racing. Our experimental results, validated both in simulation and real-world scenarios, demonstrate that our framework outperforms baseline approaches in terms of sample efficiency and overall task performance. Video is available at https://youtu.be/HfK9UT1OVnY.
引用
收藏
页码:2112 / 2119
页数:8
相关论文
共 50 条
  • [41] PaCo: Parameter-Compositional Multi-Task Reinforcement Learning
    Sun, Lingfeng
    Zhang, Haichao
    Xu, Wei
    Tomizuka, Masayoshi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [42] Multi-task Self-Supervised Adaptation for Reinforcement Learning
    Wu, Keyu
    Chen, Zhenghua
    Wu, Min
    Xiang, Shili
    Jin, Ruibing
    Zhang, Le
    Li, Xiaoli
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 15 - 20
  • [43] Multi-Task Reinforcement Meta-Learning in Neural Networks
    Shakah, Ghazi
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (07) : 263 - 269
  • [44] Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
    Oh, Junhyuk
    Singh, Satinder
    Lee, Honglak
    Kohli, Pushmeet
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [45] Multi-Drone Collaborative Shepherding Through Multi-Task Reinforcement Learning
    Wang, Guanghui
    Peng, Junkun
    Guan, Chenyang
    Chen, Jinhua
    Guo, Bing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 10311 - 10318
  • [46] Learning Multi-Task Transferable Rewards via Variational Inverse Reinforcement Learning
    Yoo, Se-Wook
    Seo, Seung-Woo
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [47] A Hybrid Multi-Task Learning Approach for Optimizing Deep Reinforcement Learning Agents
    Varghese, Nelson Vithayathil
    Mahmoud, Qusay H.
    IEEE ACCESS, 2021, 9 : 44681 - 44703
  • [48] Decision making on robot with multi-task using deep reinforcement learning for each task
    Shimoguchi, Yuya
    Kurashige, Kentarou
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 3460 - 3465
  • [49] Genetically-regulated Neuromodulation Facilitates Multi-Task Reinforcement Learning
    Cussat-Blanc, Sylvain
    Harrington, Kyle I. S.
    GECCO'15: PROCEEDINGS OF THE 2015 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2015, : 551 - 558
  • [50] Computational task offloading algorithm based on deep reinforcement learning and multi-task dependency
    Zhang, Xiaoqi
    Lin, Tengxiang
    Lin, Cheng-Kuan
    Chen, Zhen
    Cheng, Hongju
    THEORETICAL COMPUTER SCIENCE, 2024, 993