A memory-based reinforcement learning model utilizing macro-actions

被引:2
|
作者
Murata, M [1 ]
Ozawa, S [1 ]
机构
[1] Kobe Univ, Grad Sch Sci & Technol, Kobe, Hyogo, Japan
关键词
D O I
10.1007/3-211-27389-1_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the difficulties in reinforcement learning (RL) is that an optimal policy is acquired through enormous trials. As a solution to reduce waste explorations in learning, recently the exploitation of macro-actions has been focused. In this paper, we propose a memory-based reinforcement learning model in which macro-actions are generated and exploited effectively. Through the experiments for two standard tasks, we confirmed that our proposed method could decrease waste explorations especially in the early training stage. This property contributes to enhancing training efficiency in RL tasks.
引用
收藏
页码:78 / 81
页数:4
相关论文
共 50 条
  • [31] A Memory-based Reinforcement Learning Algorithm for Partially Observable Markovian Decision Processes
    Zheng, Lei
    Cho, Siu-Yeung
    Quek, Chai
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 800 - 805
  • [32] Incremental Model Enhancement via Memory-based Contrastive Learning
    Xuan, Shiyu
    Yang, Ming
    Zhang, Shiliang
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024,
  • [33] Memory-based social agent's actions and mental states design model
    Shao, K
    Liu, ZT
    Sun, ZY
    [J]. 2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 871 - 875
  • [34] Memory-Based Deep Reinforcement Learning for Obstacle Avoidance in UAV With Limited Environment Knowledge
    Singla, Abhik
    Padakandla, Sindhu
    Bhatnagar, Shalabh
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (01) : 107 - 118
  • [35] Memory-based crowd-aware robot navigation using deep reinforcement learning
    Sunil Srivatsav Samsani
    Husna Mutahira
    Mannan Saeed Muhammad
    [J]. Complex & Intelligent Systems, 2023, 9 : 2147 - 2158
  • [36] Incremental Learning of Planning Actions in Model-Based Reinforcement Learning
    Ng, Jun Hao Alvin
    Petrick, Ronald P. A.
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3195 - 3201
  • [37] Memory-based crowd-aware robot navigation using deep reinforcement learning
    Samsani, Sunil Srivatsav
    Mutahira, Husna
    Muhammad, Mannan Saeed
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (02) : 2147 - 2158
  • [38] A tabular approach memory-based learning
    [J]. Lin, C.-S. (linc@missouri.edu), 1600, Taylor and Francis Inc. (05):
  • [39] Memory-based learning for visual odometry
    Roberts, Richard
    Nguyen, Hai
    Krishnamurthi, Niyant
    Balch, Tucker
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 47 - 52
  • [40] An associative memory-based learning model with an efficient hardware implementation in FPGA
    Ahmadi, Ali
    Mattausch, Hans Juergen
    Abedin, M. Anwarul
    Saeidi, Mahmoud
    Koide, Tetsushi
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2011, 38 (04) : 3499 - 3513