Action control, forward models and expected rewards: representations in reinforcement learning

被引:0
|
作者
Rusanen, Anna-Mari [1 ]
Lappi, Otto [1 ]
Kuokkanen, Jesse [1 ]
Pekkanen, Jami [1 ]
机构
[1] Univ Helsinki, Dept Digital Human, Cognit Sci, POB 59, Helsinki 00014, Finland
关键词
Representation; Reinforcement learning; Action control; Radical enactivism; Cognitive science; RECEPTIVE FIELDS; MOTOR; ARCHITECTURE; PHILOSOPHY; PRINCIPLES; CEREBELLUM; IMAGERY;
D O I
10.1007/s11229-021-03408-w
中图分类号
N09 [自然科学史]; B [哲学、宗教];
学科分类号
01 ; 0101 ; 010108 ; 060207 ; 060305 ; 0712 ;
摘要
The fundamental cognitive problem for active organisms is to decide what to do next in a changing environment. In this article, we analyze motor and action control in computational models that utilize reinforcement learning (RL) algorithms. In reinforcement learning, action control is governed by an action selection policy that maximizes the expected future reward in light of a predictive world model. In this paper we argue that RL provides a way to explicate the so-called action-oriented views of cognitive systems in representational terms.
引用
收藏
页码:14017 / 14033
页数:17
相关论文
共 50 条
  • [41] Active Exploration Deep Reinforcement Learning for Continuous Action Space with Forward Prediction
    Zhao, Dongfang
    Huanshi, Xu
    Xun, Zhang
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
  • [42] Active Exploration Deep Reinforcement Learning for Continuous Action Space with Forward Prediction
    Dongfang Zhao
    Xu Huanshi
    Zhang Xun
    International Journal of Computational Intelligence Systems, 17
  • [43] Dynamic Action Space Handling Method for Reinforcement Learning models
    Woo, Sangchul
    Sung, Yunsick
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2020, 16 (05): : 1223 - 1230
  • [44] Advising reinforcement learning toward scaling agents in continuous control environments with sparse rewards
    Ren, Hailin
    Ben-Tzvi, Pinhas
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 90
  • [45] Model Predictive Control-Based Reinforcement Learning Using Expected Sarsa
    Moradimaryamnegari, Hoomaan
    Frego, Marco
    Peer, Angelika
    IEEE ACCESS, 2022, 10 : 81177 - 81191
  • [46] Evaluating reinforcement learning state representations for adaptive traffic signal control
    Genders, Wade
    Razavi, Saiedeh
    9TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT 2018) / THE 8TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY (SEIT-2018) / AFFILIATED WORKSHOPS, 2018, 130 : 26 - 33
  • [47] Neural Oscillatory Models for Multiscale Time Representations in Novel Reinforcement Learning Automata
    Tarlton, Michael
    Yazidi, Anis
    Mello, Gustavo
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S91 - S91
  • [48] Neural Oscillatory Models for Multiscale Time Representations in Novel Reinforcement Learning Automata
    Tarlton, Michael
    Yazidi, Anis
    Mello, Gustavo
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2024, 52 : S91 - S91
  • [49] Inverse Reinforcement Learning with Simultaneous Estimation of Rewards and Dynamics
    Herman, Michael
    Gindele, Tobias
    Wagner, Joerg
    Schmitt, Felix
    Burgard, Wolfram
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 51, 2016, 51 : 102 - 110
  • [50] Reinforcement Learning Can Be More Efficient with Multiple Rewards
    Dann, Christoph
    Mansour, Yishay
    Mohri, Mehryar
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 202, 2023, 202