Reinforcement learning with prior policy guidance for motion planning of dual-arm free-floating space robot

被引:14
|
作者
Cao, Yuxue [1 ]
Wang, Shengjie [2 ]
Zheng, Xiang [3 ]
Ma, Wenke [4 ]
Xie, Xinru [1 ]
Liu, Lei [1 ]
机构
[1] Beijing Inst Control Engn, Beijing, Peoples R China
[2] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Qian Xuesen Lab Space Technol, Beijing, Peoples R China
关键词
Compendex;
D O I
10.1016/j.ast.2022.108098
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Reinforcement learning methods as a promising technique have achieved superior results in the motion planning of free-floating space robots. However, due to the increase in planning dimension and the intensification of system dynamics coupling, the motion planning of dual-arm free-floating space robots remains an open challenge. In particular, the current study cannot handle the task of capturing a noncooperative object due to the lack of the pose constraint of the end-effectors. To address the problem, we propose a novel algorithm, EfficientLPT, to facilitate RL-based methods to improve planning accuracy efficiently. Our core contributions are constructing a mixed policy with prior knowledge guidance and introducing II center dot Iloo to build a more reasonable reward function. Furthermore, our method successfully captures a rotating object with different spinning speeds.(c) 2023 Elsevier Masson SAS. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Reinforcement learning in dual-arm trajectory planning for a free-floating space robot
    Wu, Yun-Hua
    Yu, Zhi-Cheng
    Li, Chao-Yong
    He, Meng-Jie
    Hua, Bing
    Chen, Zhi-Ming
    [J]. AEROSPACE SCIENCE AND TECHNOLOGY, 2020, 98
  • [2] Predefined-Time Trajectory Planning for a Dual-Arm Free-Floating Space Robot
    Liu, Yicheng
    Yan, Wen
    Yu, Chunxiao
    Zhang, Tao
    Tu, Haiyan
    [J]. IECON 2020: THE 46TH ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2020, : 2798 - 2803
  • [3] Robust coordinated control of a free-floating dual-arm space robot
    Wang, Cong-Qing
    Shi, Zong-Kun
    Yuan, Hua
    [J]. Yuhang Xuebao/Journal of Astronautics, 2005, 26 (04): : 436 - 440
  • [4] Hybrid vibration suppression for a free-floating flexible dual-arm space robot
    Wang, Cong-Qing
    Ke, Chang-Jun
    [J]. Zhendong Gongcheng Xuebao/Journal of Vibration Engineering, 2009, 22 (01): : 31 - 35
  • [5] Control of Free-Floating Space Dual-Arm Robot for Capturing Moving Targets
    Li, Liang
    Li, Jian-Fei
    Zhang, Da-Wei
    Wang, Ning-Fei
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 (06): : 615 - 623
  • [6] KINEMATICS, MOTION PLANNING AND DESIGN OF A FREE-FLOATING DUAL-ARM PLANAR MANIPULATOR
    AGRAWAL, SK
    SHIRUMALLA, S
    [J]. MECHANISM AND MACHINE THEORY, 1994, 29 (05) : 691 - 700
  • [7] Trajectory planning of a free-floating dual-arm space robot with minimal base disturbance in obstacle environments
    Hong, Mengqing
    Wang, Lu
    Liu, Liaoxue
    Wang, Qun
    Guo, Yu
    [J]. ADVANCES IN SPACE RESEARCH, 2024, 74 (03) : 1410 - 1423
  • [8] Adaptive control schemes of free-floating dual-arm space robot system in joint space
    Hong Zhaobin
    Chen Li
    [J]. PROCEEDINGS OF THE 26TH CHINESE CONTROL CONFERENCE, VOL 3, 2007, : 761 - +
  • [9] Augmented adaptive control of free-floating dual-arm space robot system in inertial space
    College of Mechanical Engineering, Fuzhou University, Fuzhou 350002, China
    [J]. Gongcheng Lixue, 2008, 1 (224-228): : 224 - 228
  • [10] Augmented adaptive control for free-floating dual-arm space robot system in joint space
    Guo Yishen
    Chen Li
    [J]. 2006 CHINESE CONTROL CONFERENCE, VOLS 1-5, 2006, : 2162 - +