Reinforcement learning and model predictive control for robust embedded quadrotor guidance and control

被引:37
|
作者
Greatwood, Colin [1 ,2 ]
Richards, Arthur G. [1 ,2 ]
机构
[1] Univ Bristol, Dept Aerosp Engn, Queens Bldg,Univ Walk, Bristol BS8 1TR, Avon, England
[2] Bristol Robot Lab, Bristol, Avon, England
关键词
Model predictive control; Reinforcement learning; Exploration; Micro air vehicle; CONTROL-SYSTEM; MPC;
D O I
10.1007/s10514-019-09829-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new method for enabling a quadrotor micro air vehicle (MAV) to navigate unknown environments using reinforcement learning (RL) and model predictive control (MPC) is developed. An efficient implementation of MPC provides vehicle control and obstacle avoidance. RL is used to guide the MAV through complex environments where dead-end corridors may be encountered and backtracking is necessary. All of the presented algorithms were deployed on embedded hardware using automatic code generation from Simulink. Results are given for flight tests, demonstrating that the algorithms perform well with modest computing requirements and robust navigation.
引用
收藏
页码:1681 / 1693
页数:13
相关论文
共 50 条
  • [1] Reinforcement learning and model predictive control for robust embedded quadrotor guidance and control
    Colin Greatwood
    Arthur G. Richards
    [J]. Autonomous Robots, 2019, 43 : 1681 - 1693
  • [2] Control of UAV quadrotor using reinforcement learning and robust controller
    Zhang, Zizuo
    Yang, Haiyang
    Fei, Yuanyuan
    Sun, Changyin
    Yu, Yao
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2023, 17 (12): : 1599 - 1610
  • [3] Robust Quadrotor Control through Reinforcement Learning with Disturbance Compensation
    Pi, Chen-Huan
    Ye, Wei-Yuan
    Cheng, Stone
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [4] Robust reinforcement learning control for quadrotor with input delay and uncertainties
    Zhang, Zizuo
    Fei, Yuanyuan
    Zhou, Jiayi
    Yu, Yao
    Sun, Changyin
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2024, 361 (13):
  • [5] Control of a Quadrotor With Reinforcement Learning
    Hwangbo, Jemin
    Sa, Inkyu
    Siegwart, Roland
    Hutter, Marco
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (04): : 2096 - 2103
  • [6] Model Predictive Control for Vision-Based Quadrotor Guidance
    Mueller, Karsten
    Fennel, Michael
    Trommer, Gert F.
    [J]. 2020 IEEE/ION POSITION, LOCATION AND NAVIGATION SYMPOSIUM (PLANS), 2020, : 50 - 61
  • [7] A Novel Reinforcement Learning-Based Robust Control Strategy for a Quadrotor
    Hua, Hean
    Fang, Yongchun
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (03) : 2812 - 2821
  • [8] Model Predictive Control Guided Reinforcement Learning Control Scheme
    Xie, Huimin
    Xu, Xinghai
    Li, Yuling
    Hong, Wenjing
    Shi, Jia
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [9] Adaptive Model Predictive Control of a Quadrotor
    Chikasha, Piwai N.
    Dube, Chioniso
    [J]. IFAC PAPERSONLINE, 2017, 50 (02): : 157 - 162
  • [10] Reinforcement Learning versus Model Predictive Control on greenhouse climate control
    Morcego, Bernardo
    Yin, Wenjie
    Boersma, Sjoerd
    van Henten, Eldert
    Puig, Vicenc
    Sun, Congcong
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 215