Improving Control Performance of Unmanned Aerial Vehicles through Shared Experience

被引:3
|
作者
Jardine, Peter Travis [1 ]
Givigi, Sidney [2 ]
机构
[1] Royal Mil Coll Canada, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Queens Univ, Sch Comp, Kingston, ON, Canada
关键词
Model predictive contol; Learning automata; Unmanned aerial vehicles; Reinforcement learning; PREDICTIVE CONTROL;
D O I
10.1007/s10846-021-01387-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work proposes a novel approach for improving the control performance of Unmanned Aerial Vehicles (UAVs) through cooperative reinforcement learning. By sharing their experience, it is shown that multiple UAVs can work together to converge on a set of optimal Model Predictive Control (MPC) parameters faster than when working on their own. In order to benefit from this shared experience, the UAVs must coordinate their learning strategies. Here, we proposed a Leader-Follower approach, whereby the Leader ensures all trials are drawn from the same distribution and contribute to a common payoff game of Learning Automata. Experimental results show that this approach results in faster learning without any loss of performance.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Improving Control Performance of Unmanned Aerial Vehicles through Shared Experience
    Peter Travis Jardine
    Sidney Givigi
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [2] Correction to: Improving Control Performance of Unmanned Aerial Vehicles through Shared Experience
    Peter Travis Jardine
    Sidney Givigi
    Journal of Intelligent & Robotic Systems, 2022, 104
  • [3] Improving Control Performance of Unmanned Aerial Vehicles through Shared Experience (vol 102, 68, 2021)
    Jardine, Peter Travis
    Givigi, Sidney
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (02)
  • [4] Data-driven optimal shared control of unmanned aerial vehicles
    Tan, Junkai
    Xue, Shuangsi
    Guo, Zihang
    Li, Huan
    Cao, Hui
    Chen, Badong
    NEUROCOMPUTING, 2025, 622
  • [5] Unmanned Aerial Vehicles and Control
    Fregene, Kingsley
    IEEE CONTROL SYSTEMS MAGAZINE, 2012, 32 (05): : 32 - 34
  • [6] Prospects of Improving Agricultural and Water Productivity through Unmanned Aerial Vehicles
    Nhamo, Luxon
    Magidi, James
    Nyamugama, Adolph
    Clulow, Alistair D.
    Sibanda, Mbulisi
    Chimonyo, Vimbayi G. P.
    Mabhaudhi, Tafadzwanashe
    AGRICULTURE-BASEL, 2020, 10 (07): : 1 - 18
  • [7] IMPROVING THE ENVIRONMENTAL MONITORING PROCESS THROUGH THE APPLICATION OF UNMANNED AERIAL VEHICLES
    Petrova, T.
    Petkova-Georgieva, St
    Petrov, Zh
    JOURNAL OF ENVIRONMENTAL PROTECTION AND ECOLOGY, 2021, 22 (03): : 1144 - 1150
  • [8] Swarm Control in Unmanned Aerial Vehicles
    Hexmoor, H
    McLaughlan, B
    Baker, M
    ICAI '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOLS 1 AND 2, 2005, : 911 - 917
  • [9] Control system for Unmanned Aerial Vehicles
    Spinka, Ondrej
    Kroupa, Stepan
    Hanzalek, Zdenek
    2007 5TH IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS, VOLS 1-3, 2007, : 455 - 460
  • [10] Supervising Control for Unmanned Aerial Vehicles
    Sarwar, Saeed Ur Rehman
    Rehman, Saeed Ur
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013