Deep Reinforcement Learning Boosted by External Knowledge

被引:5
|
作者
Bougie, Nicolas [1 ]
Ichise, Ryutaro [1 ]
机构
[1] Natl Inst Informat, Chiyoda Ku, 2-1-2 Hitotsubashi, Tokyo 1018430, Japan
关键词
Reinforcement Learning; Object Recognition; External Knowledge; Deep Learning; Knowledge Reasoning;
D O I
10.1145/3167132.3167165
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recent improvements in deep reinforcement learning have allowed to solve problems in many 2D domains such as Atari games. However, in complex 3D environments, numerous learning episodes are required which may be too time consuming or even impossible especially in real-world scenarios. We present a new architecture to combine external knowledge and deep reinforcement learning using only visual input. A key concept of our system is augmenting image input by adding environment feature information and combining two sources of decision. We evaluate the performances of our method in a 3D partially-observable environment from the Microsoft Malmo platform. Experimental evaluation exhibits higher performance and faster learning compared to a single reinforcement learning model.
引用
收藏
页码:331 / 338
页数:8
相关论文
共 50 条
  • [21] Deep Reinforcement Learning with Knowledge Transfer for Online Rides Order Dispatching
    Wang, Zhaodong
    Qin, Zhiwei
    Tang, Xiaocheng
    Ye, Jieping
    Zhu, Hongtu
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 617 - 626
  • [22] Knowledge Transfer using Model-Based Deep Reinforcement Learning
    Boloka, Tlou
    Makondo, Ndivhuwo
    Rosman, Benjamin
    [J]. 2021 SOUTHERN AFRICAN UNIVERSITIES POWER ENGINEERING CONFERENCE/ROBOTICS AND MECHATRONICS/PATTERN RECOGNITION ASSOCIATION OF SOUTH AFRICA (SAUPEC/ROBMECH/PRASA), 2021,
  • [23] Knowledge Reasoning Method Based on Deep Transfer Reinforcement Learning: DTRLpath
    Lin, Shiming
    Ye, Ling
    Zhuang, Yijie
    Lu, Lingyun
    Zheng, Shaoqiu
    Huang, Chenxi
    Kwee, Ng Yin
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (01): : 299 - 317
  • [24] Fusing Knowledge and Deep Reinforcement Learning for Home Demand Response Optimization
    Su, Yongxin
    Zhang, Tao
    Tan, Mao
    Peng, Hanmei
    [J]. Zhongguo Dianji Gongcheng Xuebao/Proceedings of the Chinese Society of Electrical Engineering, 2023, 43 (05): : 1855 - 1866
  • [25] Cooperative Wind Farm Control With Deep Reinforcement Learning and Knowledge-Assisted Learning
    Zhao, Huan
    Zhao, Junhua
    Qiu, Jing
    Liang, Gaoqi
    Dong, Zhao Yang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (11) : 6912 - 6921
  • [26] Deep Reinforcement Learning with external control: Self-driving car application
    Youssef, Fenjiro
    Houda, Benbrahim
    [J]. 4TH INTERNATIONAL CONFERENCE ON SMART CITY APPLICATIONS (SCA' 19), 2019,
  • [27] From Reinforcement Learning to Deep Reinforcement Learning: An Overview
    Agostinelli, Forest
    Hocquet, Guillaume
    Singh, Sameer
    Baldi, Pierre
    [J]. BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 : 298 - 328
  • [28] Efficient Massive-Device Orchestration Through Reinforcement Learning With Boosted Deep Deterministic Policy Gradient
    Shi, Haowei
    Zou, Jiadao
    Zhang, Qingxue
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (03) : 5143 - 5154
  • [29] Heterogeneous Reinforcement Learning Network for Aspect-Based Sentiment Classification With External Knowledge
    Cao, Yukun
    Tang, Yijia
    Du, Haizhou
    Xu, Feifei
    Wei, Ziyue
    Jin, Chengkun
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 3362 - 3375
  • [30] KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge
    Zhang, Peng
    Hao, Jianye
    Wang, Weixun
    Tang, Hongyao
    Ma, Yi
    Duan, Yihai
    Zheng, Yan
    [J]. PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2291 - 2297