Application of Neural ODE with embedded hybrid method for robotic manipulator control

被引:6
|
作者
Meleshkova, Zoya [1 ]
Ivanov, Sergei Evgenievich [1 ]
Ivanova, Lubov [1 ]
机构
[1] ITMO Natl Res Univ ITMO Univ St Petersburg, 49 Kronverksky Pr, St Petersburg, Russia
关键词
machine learning; model-based reinforcement learning; neural ODE; hybrid method;
D O I
10.1016/j.procs.2021.10.032
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The paper presents an approach to machine learning involving the use of a hybrid method in Neural ODE. The authors consider a way of the Neural ODE application with an embedded hybrid method for intelligent manipulator control in a non-deterministic environment. To reduce computational resources, the number of layers of the neural network using ODE is reduced, the solution of which is carried out by a hybrid transformation method. The hybrid method includes normalizing the system, linear transformation, and polynomial transformation. Using the hybrid method in Neural ODE can increase the learning and computation speed. The transformation method has high accuracy with low computational complexity of the algorithm. As a result of applying the hybrid method, the original nonlinear system is transformed to a simpler form. To solve the simplified transformed system, the scheme of the numerical Runge-Kutta method of the third order with an adaptive step is used. The results of the computational experiment show an increase in the speed and accuracy of the calculation. The presented approach to implementing the hybrid method in Neural ODE allows faster training of the neural network of the world model on limited data obtained from the real environment. After training on the data generated by the model of the world, a robotic arm always successfully reaches the object during subsequent interaction with the real environment. This solves the problem of the limited ability of the agent to interact when learning with the real environment in robotic systems. (C) 2021 The Authors. Published by Elsevier B.V.
引用
收藏
页码:314 / 324
页数:11
相关论文
共 50 条
  • [21] Adaptive Neural Network Control for a Robotic Manipulator with Unknown Deadzone
    Ge, Shuzhi Sam
    He, Wei
    Xiao, Shengtao
    2013 32ND CHINESE CONTROL CONFERENCE (CCC), 2013, : 2997 - 3002
  • [22] Control Design of Robotic Manipulator Based on Quantum Neural Network
    Abdulridha, Hayder Mahdi
    Hassoun, Zainab Abdullah
    JOURNAL OF DYNAMIC SYSTEMS MEASUREMENT AND CONTROL-TRANSACTIONS OF THE ASME, 2018, 140 (06):
  • [23] Neural network compensator based PD control of robotic manipulator
    Wang, Liang-Yong
    Chai, Tian-You
    Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2009, 29 (12): : 110 - 115
  • [24] Adaptive Neural Impedance Control of a Robotic Manipulator With Input Saturation
    He, Wei
    Dong, Yiting
    Sun, Changyin
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (03): : 334 - 344
  • [25] Visual Control of Robotic Manipulator Based on Artificial Neural Network
    Hashimoto, Hideki
    Kubota, Takashi
    Sato, Motoo
    Harashima, Fumio
    Journal of Robotics and Mechatronics, 1991, 3 (05) : 394 - 400
  • [26] Adaptive Hybrid Force-Position Control of a Robotic Manipulator
    Nganga-Kouya, Donatien
    PROCEEDINGS OF THE 2ND EUROPEAN COMPUTING CONFERENCE: NEW ASPECTS ON COMPUTERS RESEACH, 2008, : 323 - +
  • [27] The estimation of dynamic parameters of a robotic manipulator by neural network method
    Sharan, AM
    Aggarwal, R
    SIXTH, SEVENTH, AND EIGHTH WORKSHOPS ON VIRTUAL INTELLIGENCE: ACADEMIC/INDUSTRIAL/NASA/DEFENSE TECHNICAL INTERCHANGE AND TUTORIALS, 1996, 2878 : 171 - 203
  • [28] APPLICATION OF NEURAL NETWORK-BASED SERVO CONTROLLER TO POSITION, FORCE AND STABBING CONTROL BY ROBOTIC MANIPULATOR
    FUKUDA, T
    KURIHARA, T
    SHIBATA, T
    TOKITA, M
    MITSUOKA, T
    JSME INTERNATIONAL JOURNAL SERIES III-VIBRATION CONTROL ENGINEERING ENGINEERING FOR INDUSTRY, 1991, 34 (02): : 303 - 309
  • [29] A Novel Hybrid Control Method for the Underwater Manipulator
    Wang, Liquan
    Wang, Caidong
    Wang, Wenming
    Wang, Chengjun
    2008 INTERNATIONAL WORKSHOP ON EDUCATION TECHNOLOGY AND TRAINING AND 2008 INTERNATIONAL WORKSHOP ON GEOSCIENCE AND REMOTE SENSING, VOL 1, PROCEEDINGS, 2009, : 790 - 794
  • [30] Robotic hybrid position/force control based on artificial neural network method
    Zheng, Yong
    Chen, Weidong
    Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 27 (01):