Combining Supervised, Unsupervised, and Reinforcement Learning in a Network of Spiking Neurons

被引:3
|
作者
Handrich, Sebastian [1 ]
Herzog, Andreas [1 ]
Wolf, Andreas [1 ]
Herrmann, Christoph S. [1 ]
机构
[1] Otto von Guericke Univ, Inst Psychol 2, Dept Biol Psychol, D-39106 Magdeburg, Germany
关键词
DOPAMINE NEURONS; MEMORY; MODEL;
D O I
10.1007/978-90-481-9695-1_26
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The human brain constantly learns via mutiple different learning strategies. It can learn by simply having stimuli being presented to its sensory organs which is considered unsupervised learning. In addition, it can learn associations between inputs and outputs when a teacher provides the output which is considered as supervised learning. Most importantly, it can learn very efficiently if correct behaviour is followed by reward and/or incorrect behaviour is followed by punishment which is considered reinforcement learning. So far, most artificial neural architectures implement only one of the three learning mechanisms even though the brain integrates all three. Here, we have implemented unsupervised, supervised, and reinforcement learning within a network of spiking neurons. In order to achieve this ambitious goal, the existing learning rule called spike-timing dependent plasticity had to be extended such that it is modulated by the reward signal dopamine.
引用
收藏
页码:163 / 176
页数:14
相关论文
共 50 条
  • [1] Prerequisites For Integrating Unsupervised And Reinforcement Learning In A Single Network Of Spiking Neurons
    Handrich, Sebastian
    Herzog, Andreas
    Wolf, Andreas
    Herrmann, Christoph S.
    [J]. IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 1025 - 1030
  • [2] Supervised learning in spiking neurons
    Charlotte Le Mouel
    Pierre Yger
    KD Harris
    [J]. BMC Neuroscience, 14 (Suppl 1)
  • [3] Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons
    Yang, Geunbo
    Lee, Wongyu
    Seo, Youjung
    Lee, Choongseop
    Seok, Woojoon
    Park, Jongkil
    Sim, Donggyu
    Park, Cheolsoo
    [J]. SENSORS, 2023, 23 (16)
  • [4] SpiFoG: an efficient supervised learning algorithm for the network of spiking neurons
    Hussain, Irshed
    Thounaojam, Dalton Meitei
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [5] SpiFoG: an efficient supervised learning algorithm for the network of spiking neurons
    Irshed Hussain
    Dalton Meitei Thounaojam
    [J]. Scientific Reports, 10
  • [6] Unsupervised learning of head-centered representations in a network of spiking neurons
    Sebastian Thomas Philipp
    Frank Michler
    Thomas Wachtler
    [J]. BMC Neuroscience, 10 (Suppl 1)
  • [7] Reinforcement learning in populations of spiking neurons
    Robert Urbanczik
    Walter Senn
    [J]. Nature Neuroscience, 2009, 12 : 250 - 252
  • [8] Reinforcement learning in populations of spiking neurons
    Urbanczik, Robert
    Senn, Walter
    [J]. NATURE NEUROSCIENCE, 2009, 12 (03) : 250 - 252
  • [9] A New Supervised Learning Algorithm for Spiking Neurons
    Zhang, Malu
    Qu, Hong
    Li, Jianping
    Xie, Xiurui
    [J]. PROCEEDINGS OF THE 18TH ASIA PACIFIC SYMPOSIUM ON INTELLIGENT AND EVOLUTIONARY SYSTEMS, VOL 1, 2015, : 171 - 184
  • [10] A New Supervised Learning Algorithm for Spiking Neurons
    Xu, Yan
    Zeng, Xiaoqin
    Zhong, Shuiming
    [J]. NEURAL COMPUTATION, 2013, 25 (06) : 1472 - 1511