Brain-Inspired Agents for Quantum Reinforcement Learning

被引:0
|
作者
Andres, Eva [1 ]
Cuellar, Manuel Pegalajar [1 ]
Navarro, Gabriel [1 ]
机构
[1] Univ Granada, Dept Comp Sci & Artificial Intelligence, ETSI Informat & Telecomunicac, C Pdta Daniel Saucedo Aranda sSn, Granada 18014, Spain
关键词
quantum reinforcement learning; quantum neural networks; quantum spiking neural network; quantum long short-term memory; brain-inspired models; MODELS; LSTM;
D O I
10.3390/math12081230
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In recent years, advancements in brain science and neuroscience have significantly influenced the field of computer science, particularly in the domain of reinforcement learning (RL). Drawing insights from neurobiology and neuropsychology, researchers have leveraged these findings to develop novel mechanisms for understanding intelligent decision-making processes in the brain. Concurrently, the emergence of quantum computing has opened new frontiers in artificial intelligence, leading to the development of quantum machine learning (QML). This study introduces a novel model that integrates quantum spiking neural networks (QSNN) and quantum long short-term memory (QLSTM) architectures, inspired by the complex workings of the human brain. Specifically designed for reinforcement learning tasks in energy-efficient environments, our approach progresses through two distinct stages mirroring sensory and memory systems. In the initial stage, analogous to the brain's hypothalamus, low-level information is extracted to emulate sensory data processing patterns. Subsequently, resembling the hippocampus, this information is processed at a higher level, capturing and memorizing correlated patterns. We conducted a comparative analysis of our model against existing quantum models, including quantum neural networks (QNNs), QLSTM, QSNN and their classical counterparts, elucidating its unique contributions. Through empirical results, we demonstrated the effectiveness of utilizing quantum models inspired by the brain, which outperform the classical approaches and other quantum models in optimizing energy use case. Specifically, in terms of average, best and worst total reward, test reward, robustness, and learning curve.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] A Brain-Inspired Incremental Multitask Reinforcement Learning Approach
    Jin, Chenying
    Feng, Xiang
    Yu, Huiqun
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (03) : 1147 - 1160
  • [2] Brain-Inspired Emergence of Behaviors Based on the Desire for Existence by Reinforcement Learning
    Morita, Mikio
    Ishikawa, Masumi
    [J]. ADVANCES IN NEURO-INFORMATION PROCESSING, PT I, 2009, 5506 : 763 - 770
  • [3] Brain-Inspired Stigmergy Learning
    Xu, Xing
    Zhao, Zhifeng
    Li, Rongpeng
    Zhang, Honggang
    [J]. IEEE ACCESS, 2019, 7 : 54410 - 54424
  • [4] Efficient Off-Policy Reinforcement Learning via Brain-Inspired Computing
    Ni, Yang
    Abraham, Danny
    Issa, Mariam
    Kim, Yeseong
    Mercati, Pietro
    Imani, Mohsen
    [J]. PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2023, GLSVLSI 2023, 2023, : 449 - 453
  • [5] Brain-inspired computing and machine learning
    Iliadis, Lazaros S.
    Kurkova, Vera
    Hammer, Barbara
    [J]. NEURAL COMPUTING & APPLICATIONS, 2020, 32 (11): : 6641 - 6643
  • [6] BINGO: brain-inspired learning memory
    Chakraborty, Prabuddha
    Bhunia, Swarup
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (04): : 3223 - 3247
  • [7] Brain-inspired computing and machine learning
    Lazaros S. Iliadis
    Vera Kurkova
    Barbara Hammer
    [J]. Neural Computing and Applications, 2020, 32 : 6641 - 6643
  • [8] Brain-Inspired Learning on Neuromorphic Substrates
    Zenke, Friedemann
    Neftci, Emre O.
    [J]. PROCEEDINGS OF THE IEEE, 2021, 109 (05) : 935 - 950
  • [9] BINGO: brain-inspired learning memory
    Prabuddha Chakraborty
    Swarup Bhunia
    [J]. Neural Computing and Applications, 2022, 34 : 3223 - 3247
  • [10] Tutorial series on brain-inspired computing - Part 4: Reinforcement learning: Machine learning and natural learning
    Ishii, Shin
    Yoshida, Wako
    [J]. NEW GENERATION COMPUTING, 2006, 24 (03) : 325 - 350