Reinforcement learning-based finite time control for the asymmetric underactuated tethered spacecraft with disturbances

被引:0
|
作者
Lu, Yingbo [1 ]
Wang, Xingyu [1 ]
Liu, Ya [2 ]
Huang, Panfeng [3 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Elect Informat Engn, Zhengzhou 450001, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[3] Northwestern Polytech Univ, Res Ctr Intelligent Robot, Sch Astronaut, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Asymmetric underactuated tethered spacecraft; Reinforcement learning; Finite time control; Actor-critic; STABILITY; SYSTEMS; DESIGN;
D O I
10.1016/j.actaastro.2024.04.014
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This article addresses an attitude stabilization control problem for the asymmetric underactuated tethered spacecraft subject to external disturbances, and a reinforcement learning(RL)-based finite time control scheme is proposed to enhance the control performance and energy efficiency of the closed-loop system. Firstly, the error dynamics of the underactuated tethered system in the presence of external disturbances is built based on the Lagrange's modeling technique. Then, a RL-based control algorithm is implemented by a radial basis function (RBF) neural network (NN), in which the actor-critic networks are developed to obtain the optimal performance index function and the optimal controller. According to the Lyapunov theorem, semi-global finite- time stability of all the closed-loop signals is achieved through rigorous mathematical analysis, and tracking errors can be ensured to an arbitrarily small neighborhood of the origin in a finite time. Finally, comparative simulation results with hierarchical sliding mode controller are presented to demonstrate the viability of the proposed strategy.
引用
收藏
页码:218 / 229
页数:12
相关论文
共 50 条
  • [21] Reinforcement learning-based finite-time tracking control of an unknown unmanned surface vehicle with input constraints
    Wang, Ning
    Gao, Ying
    Yang, Chen
    Zhang, Xuefeng
    NEUROCOMPUTING, 2022, 484 : 26 - 37
  • [22] Rotation matrix based finite-time attitude synchronization control for spacecraft with external disturbances
    Huang, Bing
    Li, Ai-jun
    Guo, Yong
    Wang, Chang-qing
    ISA TRANSACTIONS, 2019, 85 : 141 - 150
  • [23] Reducing Controller Effort in a Deep Reinforcement Learning-based Autopilot for an Underactuated ASV
    Jose, Joel
    Kumar, Sanjeev R. S.
    Coates, Erlend M.
    IFAC PAPERSONLINE, 2024, 58 (20): : 15 - 20
  • [24] Finite-time stability of an underactuated tethered satellite system
    Wang, Chen
    Zhang, Fan
    ACTA ASTRONAUTICA, 2019, 159 : 199 - 212
  • [25] Reinforcement Learning-based path tracking for underactuated UUV under intermittent communication
    Liu Z.
    Cai W.
    Zhang M.
    Ocean Engineering, 2023, 288
  • [26] Reinforcement learning-based tracking control for a quadrotor unmanned aerial vehicle under external disturbances
    Liu, Hui
    Li, Bo
    Xiao, Bing
    Ran, Dechao
    Zhang, Chengxi
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2023, 33 (17) : 10360 - 10377
  • [27] Stable Learning-Based Tracking Control of Underactuated Balance Robots
    Han, Feng
    Yi, Jingang
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 1543 - 1550
  • [28] Incorporating Observation Uncertainty into Reinforcement Learning-Based Spacecraft Guidance Schemes
    Boone, Spencer
    Bonasera, Stefano
    McMahon, Jay
    Bosanac, Natasha
    Ahmed, Nisar
    AIAA SCITECH 2022 FORUM, 2022,
  • [29] Learning-based Modeling and Control of Underactuated Balance Robotic Systems
    Chen, Kuo
    Yi, Jingang
    Liu, Tao
    2017 13TH IEEE CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2017, : 1118 - 1123
  • [30] Underactuated attitude tracking control of tethered spacecraft for deployment and spin-up
    Tian, Haochang
    Li, Aijun
    Wang, Yu
    Wang, Changqing
    ADVANCES IN SPACE RESEARCH, 2023, 71 (11) : 4829 - 4842