Learning and Control Model of the Arm for Loading

被引:3
|
作者
Kim, Kyoungsik [1 ,2 ]
Kambara, Hiroyuki [2 ,3 ]
Shin, Duk [4 ]
Koike, Yasuharu [2 ,3 ]
机构
[1] Tokyo Inst Technol, Interdisciplinary Grad Sch Sci & Engn, Yokohama, Kanagawa 2268503, Japan
[2] JST, CREST, Kawaguchi, Saitama 3320012, Japan
[3] Tokyo Inst Technol, Precis & Intelligence Lab, Yokohama, Kanagawa 2268503, Japan
[4] Toyota Cent Res & Dev Labs Inc, Nagoya, Aichi 4801192, Japan
来源
关键词
motor control; FDM; loading; actor-critic; feedback-error-learning; MOTOR; COORDINATION; MOVEMENT;
D O I
10.1587/transinf.E92.D.705
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We propose a learning and control model of the arm for a loading task in which an object is loaded onto one hand with the other hand, in the sagittal plane. Postural control during object interactions provides important points to motor control theories in terms of how humans handle dynamics changes and use the information of prediction and sensory feedback. For the learning and control model, we coupled a feedback-error-learning scheme with an Actor-Critic method used as a feedback controller. To overcome sensory delays, a feedforward dynamics model (FDM) was used in the sensory feedback path. We tested the proposed model in simulation using a two-joint arm with six muscles, each with time delays in muscle force generation. By applying the proposed model to the loading task, we showed that motor commands started increasing, before an object was loaded on, to stabilize arm posture. We also found that the FDM contributes to the stabilization by predicting how the hand changes based on contexts of the object and efferent signals. For comparison with other computational models, we present the simulation results of a minimum-variance model.
引用
收藏
页码:705 / 716
页数:12
相关论文
共 50 条
  • [11] The Application of Learning Impedance Control to Exoskeleton Arm
    Liu, Jie
    Wang, Yu
    Tong, Heting
    Han, Ray P. S.
    [J]. ADVANCED MATERIALS RESEARCH II, PTS 1 AND 2, 2012, 463-464 : 900 - +
  • [12] Hindsight Experience Replay Improves Reinforcement Learning for Control of a MIMO Musculoskeletal Model of the Human Arm
    Crowder, Douglas C.
    Abreu, Jessica
    Kirsch, Robert F.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 1016 - 1025
  • [13] Deep Dynamic Programming: Optimal Control with Continuous Model Learning of a Nonlinear Muscle Actuated Arm
    Lonsberry, Andrew G.
    Lonsberry, Alexander J.
    Quinn, Roger D.
    [J]. BIOMIMETIC AND BIOHYBRID SYSTEMS, LIVING MACHINES 2017, 2017, 10384
  • [14] A learning feedback and feedforward neuromuscular control model for two degrees of freedom human arm movements
    Stroeve, S
    [J]. HUMAN MOVEMENT SCIENCE, 1997, 16 (05) : 621 - 651
  • [15] Neural model of cerebellar learning for arm movement control: Cortico-spino-cerebellar dynamics
    ContrerasVidal, JL
    Grossberg, S
    Bullock, D
    [J]. LEARNING & MEMORY, 1997, 3 (06) : 475 - 502
  • [16] Learning to control arm stiffness under static conditions
    Darainy, M
    Malfait, N
    Gribble, PL
    Towhidkhah, F
    Ostry, DJ
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2004, 92 (06) : 3344 - 3350
  • [17] Iterative Learning Control for Vibration Suppression of a Robotic Arm
    Lin, Jia-Liang
    Huang, Han-Pang
    Lin, Chun-Yeon
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [18] Control by interconnection of a manipulator arm using reinforcement learning
    Nageshrao, S. P.
    Lopes, G. A. D.
    Jeltsema, D.
    Babuska, R.
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL (ISIC 2015), 2015, : 47 - 52
  • [19] Vibration Control for Flexible Arm by Feedback Error Learning
    Yamazaki, Shota
    Sugimoto, Kenji
    [J]. 2015 54TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2015, : 600 - 603
  • [20] Learning Virtual Equilibrium Trajectories for Control of a Robot Arm
    Shadmehr, Reza
    [J]. NEURAL COMPUTATION, 1990, 2 (04) : 436 - 446