Reinforcement Learning-Based Prescribed Performance Motion Control of Pneumatic Muscle Actuated Robotic Arms With Measurement Noises

Featured with high power density, excellent flexibility, shock absorption capacity, etc., pneumatic muscles (PMs) promote the development of exoskeleton robots and rehabilitation equipment. However, the complex nonlinearities of PMs limit efficiency optimization in closed-loop control, while the force-displacement coupling, soft materials, deficient workspace, etc., make it more difficult to simultaneously increase motion speeds and ensure the safety of multiple PM-actuated (PMA) robots. Although force sensors can currently be replaced by applying state estimation techniques, the amplification effects of measurement noises still compromise control accuracy and stability in practice. To this end, this article proposes a reinforcement learning-based robust motion control method with the prescribed performance, which achieves efficient and satisfactory tracking control for PMA robotic arms. In particular, by elaborately incorporating an integral term, a robust generalized proportional integral observer is used to eliminate measurement noises. Meanwhile, by using an actor-critic network to optimize control performance, an error-transformation-based continuous controller is designed to guarantee the uniformly ultimately boundedness of tracking errors. Compared with most existing methods, this article provides the first solution to restrict the entire transient and steady-state performance of PMA robotic arms, improve the noise suppression capability, and optimize the control efficiency simultaneously. Finally, complete stability analysis based on Lyapunov techniques is provided, and several groups of hardware experiments demonstrate the practicability and robustness of the proposed method.