Trajectory tracking control of an unmanned aerial vehicle with deep reinforcement learning for tasks inside the EAST

被引:2
|
作者
Yu, Chao [1 ,2 ]
Yang, Yang [1 ]
Cheng, Yong [1 ]
Wang, Zheng [3 ]
Shi, Mingming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Plasma Phys, Hefei Inst Phys Sci, Hefei 230031, Peoples R China
[2] Univ Sci & Technol China, Hefei 230026, Peoples R China
[3] Hefei Univ Technol, Hefei, Peoples R China
关键词
EAST; UAV; Trajectory tracking; Remote handling; Deep reinforcement learning; CONCEPTUAL DESIGN; DEPLOYER;
D O I
10.1016/j.fusengdes.2023.113894
中图分类号
TL [原子能技术]; O571 [原子核物理学];
学科分类号
0827 ; 082701 ;
摘要
The robotic arms inside the EAST (Experimental Advanced Superconducting Tokamak) are bulky and slow, making them unable to efficiently complete remote handling tasks such as inspection and grasping. Miniature intelligent UAVs have the potential to assist in remote handling tasks. A key challenge is to achieve autonomous flight along a set trajectory within the EAST's vacuum vessel. This paper presents an autonomous UAV system with deep reinforcement learning for this purpose. The autonomous flight of a quadrotor UAV within the EAST was simulated using OpenAI Gym-style environment. To verify that the trained policy is transferable, we experimentally verified the trajectory tracking of UAVs along specific trajectories in real scenarios. The results show that our autonomous UAV system can complete trajectory-tracking flight tasks inside the EAST vacuum vessel.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Quaternion-based nonlinear trajectory tracking control of a quadrotor unmanned aerial vehicle
    Zha Changliu
    Ding Xilun
    Yu Yushu
    Wang Xueqiang
    CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2017, 30 (01) : 77 - 92
  • [32] Robust Trajectory Tracking Control for a Quadrotor Unmanned Aerial Vehicle Using Disturbance Observer
    Yang, Yi
    Wu, Qingxian
    Chen, Mou
    PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 697 - 702
  • [33] Deep Reinforcement Learning-Based Adaptive Controller for Trajectory Tracking and Altitude Control of an Aerial Robot
    Barzegar, Ali
    Lee, Deok-Jin
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [34] Trajectory tracking control of a VTOL unmanned aerial vehicle using offset-free tracking MPC
    Tayyab MANZOOR
    Yuanqing XIA
    Di-Hua ZHAI
    Dailiang MA
    Chinese Journal of Aeronautics, 2020, 33 (07) : 2024 - 2042
  • [35] Trajectory tracking control of a VTOL unmanned aerial vehicle using offset-free tracking MPC
    Manzoor, Tayyab
    Xia, Yuanqing
    Zhai, Di-Hua
    Ma, Dailiang
    CHINESE JOURNAL OF AERONAUTICS, 2020, 33 (07) : 2024 - 2042
  • [36] Trajectory tracking control of a VTOL unmanned aerial vehicle using offset-free tracking MPC
    Tayyab MANZOOR
    Yuanqing XIA
    Di-Hua ZHAI
    Dailiang MA
    Chinese Journal of Aeronautics , 2020, (07) : 2024 - 2042
  • [37] Trajectory tracking control for micro unmanned aerial vehicles
    Zhai Ruiyong
    Zhang Wendong
    Zhou Zhaoying
    Sang Shengbo
    Li Pengwei
    ADVANCES IN APPLIED SCIENCE AND INDUSTRIAL TECHNOLOGY, PTS 1 AND 2, 2013, 798-799 : 448 - +
  • [38] Unmanned Aerial Vehicle Pitch Control Using Deep Reinforcement Learning with Discrete Actions in Wind Tunnel Test
    Wada, Daichi
    Araujo-Estrada, Sergio A.
    Windsor, Shane
    AEROSPACE, 2021, 8 (01) : 1 - 16
  • [39] Research on Control of Unmanned Surface Vehicle Based on Deep Reinforcement Learning
    Li, Baoan
    Ship Building of China, 2020, 61 : 14 - 20
  • [40] Deep Reinforcement Learning for Autonomous Dynamic Skid Steer Vehicle Trajectory Tracking
    Srikonda, Sandeep
    Norris, William Robert
    Nottage, Dustin
    Soylemezoglu, Ahmet
    ROBOTICS, 2022, 11 (05)