Trajectory tracking control of an unmanned aerial vehicle with deep reinforcement learning for tasks inside the EAST

被引:2
|
作者
Yu, Chao [1 ,2 ]
Yang, Yang [1 ]
Cheng, Yong [1 ]
Wang, Zheng [3 ]
Shi, Mingming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Plasma Phys, Hefei Inst Phys Sci, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230026, Peoples R China
[3] Hefei Univ Technol, Hefei, Peoples R China
关键词
EAST; UAV; Trajectory tracking; Remote handling; Deep reinforcement learning; CONCEPTUAL DESIGN; DEPLOYER;
D O I
10.1016/j.fusengdes.2023.113894
中图分类号
TL [原子能技术]; O571 [原子核物理学];
学科分类号
0827 ; 082701 ;
摘要
The robotic arms inside the EAST (Experimental Advanced Superconducting Tokamak) are bulky and slow, making them unable to efficiently complete remote handling tasks such as inspection and grasping. Miniature intelligent UAVs have the potential to assist in remote handling tasks. A key challenge is to achieve autonomous flight along a set trajectory within the EAST's vacuum vessel. This paper presents an autonomous UAV system with deep reinforcement learning for this purpose. The autonomous flight of a quadrotor UAV within the EAST was simulated using OpenAI Gym-style environment. To verify that the trained policy is transferable, we experimentally verified the trajectory tracking of UAVs along specific trajectories in real scenarios. The results show that our autonomous UAV system can complete trajectory-tracking flight tasks inside the EAST vacuum vessel.
引用
下载
收藏
页数:10
相关论文
共 50 条
  • [1] TRAJECTORY TRACKING CONTROL FOR UNMANNED AERIAL VEHICLE
    Zaidi, Jamshaid
    Butt, Hamza
    Nadeem, Zobia
    Waseem, Hasher
    Yousuf, Bilal M.
    Mohsin, Haris
    2018 3RD INTERNATIONAL CONFERENCE ON EMERGING TRENDS IN ENGINEERING, SCIENCES AND TECHNOLOGY (ICEEST), 2018,
  • [2] Fast and Accurate Trajectory Tracking for Unmanned Aerial Vehicles based on Deep Reinforcement Learning
    Li, Yilan
    Li, Hongjia
    Li, Zhe
    Fang, Haowen
    Sanyal, Amit K.
    Wang, Yanzhi
    Qiu, Qinru
    2019 IEEE 25TH INTERNATIONAL CONFERENCE ON EMBEDDED AND REAL-TIME COMPUTING SYSTEMS AND APPLICATIONS (RTCSA 2019), 2019,
  • [3] Fuzzy swarm trajectory tracking control of unmanned aerial vehicle
    Selma, Boumediene
    Chouraqui, Samira
    Abouaissa, Hassane
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2020, 7 (04) : 435 - 447
  • [4] Unmanned Aerial Vehicle Trajectory Planning via Staged Reinforcement Learning
    Xi, Chenyang
    Liu, Xinfu
    2020 INTERNATIONAL CONFERENCE ON UNMANNED AIRCRAFT SYSTEMS (ICUAS'20), 2020, : 246 - 255
  • [5] Multi-target tracking for unmanned aerial vehicle swarms using deep reinforcement learning
    Zhou, Wenhong
    Liu, Zhihong
    Li, Jie
    Xu, Xin
    Shen, Lincheng
    NEUROCOMPUTING, 2021, 466 : 285 - 297
  • [6] Autonomous control of unmanned aerial vehicle for chemical detection using deep reinforcement learning
    Byun, Hyung Joon
    Nam, Hyunwoo
    ELECTRONICS LETTERS, 2022, 58 (11) : 423 - 425
  • [7] Dynamics Modeling and Trajectory Tracking Control of a Quadrotor Unmanned Aerial Vehicle
    Ding, Xilun
    Wang, Xueqiang
    Yu, Yushu
    Zha, Changliu
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2017, 139 (02):
  • [8] Simple Controller for Trajectory Tracking Control of Quadrotor Unmanned Aerial Vehicle
    Mutoh, Yasuhiko
    Awatsu, Lisa
    2016 11TH FRANCE-JAPAN & 9TH EUROPE-ASIA CONGRESS ON MECHATRONICS (MECATRONICS) / 17TH INTERNATIONAL CONFERENCE ON RESEARCH AND EDUCATION IN MECHATRONICS (REM), 2016, : 213 - 218
  • [9] Trajectory Tracking and Iterative Learning on an Unmanned Aerial Vehicle using Parametrized Model Predictive Control
    Sferrazza, Carmelo
    Muehlebach, Michael
    D'Andrea, Raffaello
    2017 IEEE 56TH ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2017,
  • [10] Optimized Backstepping Tracking Control Using Reinforcement Learning for Quadrotor Unmanned Aerial Vehicle System
    Wen, Guoxing
    Hao, Wei
    Feng, Weiwei
    Gao, Kaizhou
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (08): : 5004 - 5015