Action control, forward models and expected rewards: representations in reinforcement learning

被引:0
|
作者
Rusanen, Anna-Mari [1 ]
Lappi, Otto [1 ]
Kuokkanen, Jesse [1 ]
Pekkanen, Jami [1 ]
机构
[1] Univ Helsinki, Dept Digital Human, Cognit Sci, POB 59, Helsinki 00014, Finland
关键词
Representation; Reinforcement learning; Action control; Radical enactivism; Cognitive science; RECEPTIVE FIELDS; MOTOR; ARCHITECTURE; PHILOSOPHY; PRINCIPLES; CEREBELLUM; IMAGERY;
D O I
10.1007/s11229-021-03408-w
中图分类号
N09 [自然科学史]; B [哲学、宗教];
学科分类号
01 ; 0101 ; 010108 ; 060207 ; 060305 ; 0712 ;
摘要
The fundamental cognitive problem for active organisms is to decide what to do next in a changing environment. In this article, we analyze motor and action control in computational models that utilize reinforcement learning (RL) algorithms. In reinforcement learning, action control is governed by an action selection policy that maximizes the expected future reward in light of a predictive world model. In this paper we argue that RL provides a way to explicate the so-called action-oriented views of cognitive systems in representational terms.
引用
收藏
页码:14017 / 14033
页数:17
相关论文
共 50 条
  • [1] Action control, forward models and expected rewards: representations in reinforcement learning
    Anna-Mari Rusanen
    Otto Lappi
    Jesse Kuokkanen
    Jami Pekkanen
    Synthese, 2021, 199 : 14017 - 14033
  • [2] Learning Action Representations for Reinforcement Learning
    Chandak, Yash
    Theocharous, Georgios
    Kostas, James E.
    Jordan, Scott M.
    Thomas, Philip S.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [3] From Fly Detectors to Action Control: Representations in Reinforcement Learning
    Rusanen, Anna-Mari
    Lappi, Otto
    Pekkanen, Jami
    Kuokkanen, Jesse
    PHILOSOPHY OF SCIENCE, 2021, 88 (05) : 1045 - 1054
  • [4] Video Prediction Models as Rewards for Reinforcement Learning
    Escontrela, Alejandro
    Adeniji, Ademi
    Yan, Wilson
    Jain, Ajay
    Bin Peng, Xue
    Goldberg, Ken
    Lee, Youngwoon
    Hafner, Danijar
    Abbeel, Pieter
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] The use of continuous action representations to scale deep reinforcement learning for inventory control
    Vanvuchelen, Nathalie
    De Moor, Bram J.
    Boute, Robert N.
    IMA JOURNAL OF MANAGEMENT MATHEMATICS, 2024, 36 (01) : 51 - 66
  • [6] Learning task-relevant representations via rewards and real actions for reinforcement learning
    Yuan, Linghui
    Lu, Xiaowei
    Liu, Yunlong
    KNOWLEDGE-BASED SYSTEMS, 2024, 294
  • [7] The Utility of Sparse Representations for Control in Reinforcement Learning
    Liu, Vincent
    Kumaraswamy, Raksha
    Le, Lei
    White, Martha
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4384 - 4391
  • [8] Reinforcement Learning with Perturbed Rewards
    Wang, Jingkang
    Liu, Yang
    Li, Bo
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6202 - 6209
  • [9] Learning Pseudometric-based Action Representations for Offline Reinforcement Learning
    Gu, Pengjie
    Zhao, Mengchen
    Chen, Chen
    Li, Dong
    Hao, Jianye
    An, Bo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [10] Shaping Rewards for Reinforcement Learning with Imperfect Demonstrations using Generative Models
    Wu, Yuchen
    Mozifian, Melissa
    Shkurti, Florian
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 6628 - 6634