Application of Neural ODE with embedded hybrid method for robotic manipulator control

被引:6
|
作者
Meleshkova, Zoya [1 ]
Ivanov, Sergei Evgenievich [1 ]
Ivanova, Lubov [1 ]
机构
[1] ITMO Natl Res Univ ITMO Univ St Petersburg, 49 Kronverksky Pr, St Petersburg, Russia
关键词
machine learning; model-based reinforcement learning; neural ODE; hybrid method;
D O I
10.1016/j.procs.2021.10.032
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The paper presents an approach to machine learning involving the use of a hybrid method in Neural ODE. The authors consider a way of the Neural ODE application with an embedded hybrid method for intelligent manipulator control in a non-deterministic environment. To reduce computational resources, the number of layers of the neural network using ODE is reduced, the solution of which is carried out by a hybrid transformation method. The hybrid method includes normalizing the system, linear transformation, and polynomial transformation. Using the hybrid method in Neural ODE can increase the learning and computation speed. The transformation method has high accuracy with low computational complexity of the algorithm. As a result of applying the hybrid method, the original nonlinear system is transformed to a simpler form. To solve the simplified transformed system, the scheme of the numerical Runge-Kutta method of the third order with an adaptive step is used. The results of the computational experiment show an increase in the speed and accuracy of the calculation. The presented approach to implementing the hybrid method in Neural ODE allows faster training of the neural network of the world model on limited data obtained from the real environment. After training on the data generated by the model of the world, a robotic arm always successfully reaches the object during subsequent interaction with the real environment. This solves the problem of the limited ability of the agent to interact when learning with the real environment in robotic systems. (C) 2021 The Authors. Published by Elsevier B.V.
引用
收藏
页码:314 / 324
页数:11
相关论文
共 50 条
  • [41] Neural Adaptive Backstepping Control of a Robotic Manipulator With Prescribed Performance Constraint
    Guo, Qing
    Zhang, Yi
    Celler, Branko G.
    Su, Steven W.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (12) : 3572 - 3583
  • [42] A sliding-mode control for robotic manipulator with neural network compensation
    Sun, W.
    Wang, Y. N.
    Zhai, X. H.
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 224 - 228
  • [43] Hybrid position and force control for robotic manipulator with a class of constraint uncertainty
    Cheah, CC
    Kawamura, S
    Arimoto, S
    1998 JAPAN-U.S.A. SYMPOSIUM ON FLEXIBLE AUTOMATION - PROCEEDINGS, VOLS I AND II, 1998, : 501 - 507
  • [44] Synthesis of Adaptive Control of Robotic Manipulator by the Method of Lyapunov Functions
    Bragina, A. A.
    Shcherbakov, V. P.
    Shiryaev, V. I.
    IFAC PAPERSONLINE, 2018, 51 (32): : 298 - 303
  • [45] Designing and building embedded environment for robotic control application
    Litayem, Nabil
    Ghrissi, Meftah
    Ben Salem, Ahmed Karim
    Ben Saoud, Slim
    IECON: 2009 35TH ANNUAL CONFERENCE OF IEEE INDUSTRIAL ELECTRONICS, VOLS 1-6, 2009, : 2745 - +
  • [46] COORDINATING CONTROL OF ROBOTIC MANIPULATOR
    MIROSHNIK, IV
    NIKIFOROV, VO
    INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 1995, 10 (03): : 101 - 105
  • [47] Application of a gesture classification system to the control of a rehabilitation robotic manipulator.
    Parsons, BN
    Gellrich, L
    Warner, PR
    Gill, R
    White, AS
    PROCEEDINGS OF THE 18TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOL 18, PTS 1-5, 1997, 18 : 514 - 515
  • [48] Embedded model control of networked control systems: An experimental robotic application
    Nanu, Luca
    Colangelo, Luigi
    Novara, Carlo
    Montenegro, Carlos Perez
    MECHATRONICS, 2024, 99
  • [49] Fixed-time neural network control of a robotic manipulator with input deadzone
    Wu, Yifan
    Niu, Wenkai
    Kong, Linghuan
    Yu, Xinbo
    He, Wei
    ISA TRANSACTIONS, 2023, 135 : 449 - 461
  • [50] FLEXIBLE STRUCTURAL LEANING CONTROL OF A ROBOTIC MANIPULATOR USING ARTIFICIAL NEURAL NETWORKS
    TESHNEHLAB, M
    WATANABE, K
    JSME INTERNATIONAL JOURNAL SERIES C-DYNAMICS CONTROL ROBOTICS DESIGN AND MANUFACTURING, 1995, 38 (03): : 510 - 521