Action control, forward models and expected rewards: representations in reinforcement learning

被引:0
|
作者
Rusanen, Anna-Mari [1 ]
Lappi, Otto [1 ]
Kuokkanen, Jesse [1 ]
Pekkanen, Jami [1 ]
机构
[1] Univ Helsinki, Dept Digital Human, Cognit Sci, POB 59, Helsinki 00014, Finland
关键词
Representation; Reinforcement learning; Action control; Radical enactivism; Cognitive science; RECEPTIVE FIELDS; MOTOR; ARCHITECTURE; PHILOSOPHY; PRINCIPLES; CEREBELLUM; IMAGERY;
D O I
10.1007/s11229-021-03408-w
中图分类号
N09 [自然科学史]; B [哲学、宗教];
学科分类号
01 ; 0101 ; 010108 ; 060207 ; 060305 ; 0712 ;
摘要
The fundamental cognitive problem for active organisms is to decide what to do next in a changing environment. In this article, we analyze motor and action control in computational models that utilize reinforcement learning (RL) algorithms. In reinforcement learning, action control is governed by an action selection policy that maximizes the expected future reward in light of a predictive world model. In this paper we argue that RL provides a way to explicate the so-called action-oriented views of cognitive systems in representational terms.
引用
收藏
页码:14017 / 14033
页数:17
相关论文
共 50 条
  • [31] Reinforcement learning with immediate rewards and linear hypotheses
    Abe, N
    Biermann, AW
    Long, PM
    ALGORITHMICA, 2003, 37 (04) : 263 - 293
  • [32] Expected Policy Gradients for Reinforcement Learning
    Ciosek, Kamil
    Whiteson, Shimon
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [33] Expected policy gradients for reinforcement learning
    Ciosek, Kamil
    Whiteson, Shimon
    Journal of Machine Learning Research, 2020, 21
  • [34] Hierarchical Deep Reinforcement Learning for Continuous Action Control
    Yang, Zhaoyang
    Merrick, Kathryn
    Jin, Lianwen
    Abbass, Hussein A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5174 - 5184
  • [35] Regularizing Action Policies for Smooth Control with Reinforcement Learning
    Mysore, Siddharth
    Mabsout, Bassel
    Mancuso, Renato
    Saenko, Kate
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 1810 - 1816
  • [36] Action Robust Reinforcement Learning and Applications in Continuous Control
    Tessler, Chen
    Efroni, Yonathan
    Mannor, Shie
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [37] Reinforcement Learning with Prototypical Representations
    Yarats, Denis
    Fergus, Rob
    Lazaric, Alessandro
    Pinto, Lerrel
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [38] StARformer: Transformer with State-Action-Reward Representations for Visual Reinforcement Learning
    Shang, Jinghuan
    Kahatapitiya, Kumara
    Li, Xiang
    Ryoo, Michael S.
    COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 : 462 - 479
  • [39] Graph Representations for Reinforcement Learning
    Schab, Esteban
    Casanova, Carlos
    Piccoli, Fabiana
    JOURNAL OF COMPUTER SCIENCE & TECHNOLOGY, 2024, 24 (01): : 29 - 38
  • [40] On the Generalization of Representations in Reinforcement Learning
    Le Lan, Charline
    Tu, Stephen
    Oberman, Adam
    Agarwal, Rishabh
    Bellemare, Marc
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151