Deep Reinforcement Learning Boosted by External Knowledge

被引:5
|
作者
Bougie, Nicolas [1 ]
Ichise, Ryutaro [1 ]
机构
[1] Natl Inst Informat, Chiyoda Ku, 2-1-2 Hitotsubashi, Tokyo 1018430, Japan
关键词
Reinforcement Learning; Object Recognition; External Knowledge; Deep Learning; Knowledge Reasoning;
D O I
10.1145/3167132.3167165
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recent improvements in deep reinforcement learning have allowed to solve problems in many 2D domains such as Atari games. However, in complex 3D environments, numerous learning episodes are required which may be too time consuming or even impossible especially in real-world scenarios. We present a new architecture to combine external knowledge and deep reinforcement learning using only visual input. A key concept of our system is augmenting image input by adding environment feature information and combining two sources of decision. We evaluate the performances of our method in a 3D partially-observable environment from the Microsoft Malmo platform. Experimental evaluation exhibits higher performance and faster learning compared to a single reinforcement learning model.
引用
收藏
页码:331 / 338
页数:8
相关论文
共 50 条
  • [1] Deep Reinforcement Learning Boosted Partial Domain Adaptation
    Wu, Keyu
    Wu, Min
    Yang, Jianfei
    Chen, Zhenghua
    Li, Zhengguo
    Li, Xiaoli
    [J]. PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 3192 - 3199
  • [2] Towards Knowledge Transfer in Deep Reinforcement Learning
    Glatt, Ruben
    da Silva, Felipe Leno
    Reali Costa, Anna Helena
    [J]. PROCEEDINGS OF 2016 5TH BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS 2016), 2016, : 91 - 96
  • [3] Improving Deep Reinforcement Learning with Knowledge Transfer
    Glatt, Ruben
    Reali Costa, Anna Helena
    [J]. THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 5036 - 5037
  • [4] REPAINT: Knowledge Transfer in Deep Reinforcement Learning
    Tao, Yunzhe
    Genc, Sahika
    Chung, Jonathan
    Sun, Tao
    Mallya, Sunil
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7145 - 7155
  • [5] A hierarchical framework for improving ride comfort of autonomous vehicles via deep reinforcement learning with external knowledge
    Du, Yuchuan
    Chen, Jing
    Zhao, Cong
    Liao, Feixiong
    Zhu, Meixin
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2023, 38 (08) : 1059 - 1078
  • [6] Combining Deep Reinforcement Learning with Prior Knowledge and Reasoning
    Bougie, Nicolas
    Cheng, Li Kai
    Ichise, Ryutaro
    [J]. APPLIED COMPUTING REVIEW, 2018, 18 (02): : 33 - 45
  • [7] Dynamic knowledge graph reasoning based on deep reinforcement learning
    Liu, Hao
    Zhou, Shuwang
    Chen, Changfang
    Gao, Tianlei
    Xu, Jiyong
    Shu, Minglei
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 241
  • [8] Deep Reinforcement Learning Task Assignment Based on Domain Knowledge
    Liu, Jiayi
    Wang, Gang
    Guo, Xiangke
    Wang, Siyuan
    Fu, Qiang
    [J]. IEEE Access, 2022, 10 : 114402 - 114413
  • [9] Towards Interpretable Reinforcement Learning with State Abstraction Driven by External Knowledge
    Bougie, Nicolas
    Ichise, Ryutaro
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2020, E103D (10) : 2143 - 2153
  • [10] Leveraging Domain Knowledge for Robust Deep Reinforcement Learning in Networking
    Zheng, Ying
    Chen, Haoyu
    Duan, Qingyang
    Lin, Lixiang
    Shao, Yiyang
    Wang, Wei
    Wang, Xin
    Xu, Yuedong
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,