A neural model of the frontal eye fields with. reward-based learning

被引:1
|
作者
Ye, Weijie [1 ]
Liu, Shenquan [1 ]
Liu, Xuanliang [1 ]
Yu, Yuguo [2 ,3 ]
机构
[1] South China Univ Technol, Sch Math, Guangzhou 510640, Guangdong, Peoples R China
[2] Fudan Univ, Sch Life Sci, State Key Lab Med Neurobiol, Ctr Computat Syst Biol, Shanghai 200433, Peoples R China
[3] Fudan Univ, Sch Life Sci, Inst Brain Sci, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Decision-making; Task switching; Reward-based Hebbian learning; Direction-preferred population; PRIMATE PREFRONTAL CORTEX; PERCEPTUAL DECISION-MAKING; CONDITIONAL OCULOMOTOR ASSOCIATIONS; WORKING-MEMORY CAPACITY; BASAL GANGLIA CIRCUITS; PRIMARY VISUAL-CORTEX; ANTI-SACCADE TASK; COGNITIVE CONTROL; NEURONAL-ACTIVITY; INHIBITORY CONTROL;
D O I
10.1016/j.neunet.2016.05.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decision-making is a flexible process dependent on the accumulation of various kinds of information; however, the corresponding neural mechanisms are far from clear. We extended a layered model of the frontal eye field to a learning-based model, using computational simulations to explain the cognitive process of choice tasks. The core of this extended model has three aspects: direction-preferred populations that cluster together the neurons with the same orientation preference, rule modules that control different rule-dependent activities, and reward-based synaptic plasticity that modulates connections to flexibly change the decision according to task demands. After repeated attempts in a number of trials, the network successfully simulated three decision choice tasks: an anti-saccade task, a no-go task, and an associative task. We found that synaptic plasticity could modulate the competition of choices by suppressing erroneous choices while enhancing the correct (rewarding) choice. In addition, the trained model captured some properties exhibited in animal and human experiments, such as the latency of the reaction time distribution of anti-saccades, the stop signal mechanism for canceling a reflexive saccade, and the variation of latency to half-max selectivity. Furthermore, the trained model was capable of reproducing the re-learning procedures when switching tasks and reversing the cue -saccade association. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:39 / 51
页数:13
相关论文
共 50 条
  • [1] Evolving Neural Turing Machines for Reward-based Learning
    Greve, Rasmus Boll
    Jacobsen, Emil Juul
    Risi, Sebastian
    [J]. GECCO'16: PROCEEDINGS OF THE 2016 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2016, : 117 - 124
  • [2] Spiking Neural Network with Lateral Inhibition for Reward-Based Associative Learning
    Yusoff, Nooraini
    Ahmad, Farzana Kabir
    [J]. NEURAL INFORMATION PROCESSING (ICONIP 2014), PT I, 2014, 8834 : 327 - 334
  • [3] Neural Correlates of Reward-Based Spatial Learning in Persons with Cocaine Dependence
    Gregory Z Tau
    Rachel Marsh
    Zhishun Wang
    Tania Torres-Sanchez
    Barbara Graniello
    Xuejun Hao
    Dongrong Xu
    Mark G Packard
    Yunsuo Duan
    Alayar Kangarlu
    Diana Martinez
    Bradley S Peterson
    [J]. Neuropsychopharmacology, 2014, 39 : 545 - 555
  • [4] Neural Correlates of Reward-Based Spatial Learning in Persons with Cocaine Dependence
    Tau, Gregory Z.
    Marsh, Rachel
    Wang, Zhishun
    Torres-Sanchez, Tania
    Graniello, Barbara
    Hao, Xuejun
    Xu, Dongrong
    Packard, Mark G.
    Duan, Yunsuo
    Kangarlu, Alayar
    Martinez, Diana
    Peterson, Bradley S.
    [J]. NEUROPSYCHOPHARMACOLOGY, 2014, 39 (03) : 545 - 555
  • [5] Spiking neural network with lateral inhibition for reward-based associative learning
    Yusoff, Nooraini
    Ahmad, Farzana Kabir
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8834 : 327 - 334
  • [6] Implicit reward-based motor learning
    van Mastrigt, Nina M.
    Tsay, Jonathan S.
    Wang, Tianhe
    Avraham, Guy
    Abram, Sabrina J.
    van der Kooij, Katinka
    Smeets, Jeroen B. J.
    Ivry, Richard B.
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2023, 241 (09) : 2287 - 2298
  • [7] Reward-based learning of a redundant task
    Tamagnone, Irene
    Casadio, Maura
    Sanguineti, Vittorio
    [J]. 2013 IEEE 13TH INTERNATIONAL CONFERENCE ON REHABILITATION ROBOTICS (ICORR), 2013,
  • [8] Dimensional reduction for reward-based learning
    Swinehart, Christian D.
    Abbott, L. F.
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2006, 17 (03) : 235 - 252
  • [9] Computational Insights into Reward-Based Learning
    O'Reilly, Randall C.
    [J]. BIOLOGICAL PSYCHIATRY, 2012, 71 (08) : 217S - 217S
  • [10] Implicit reward-based motor learning
    Nina M. van Mastrigt
    Jonathan S. Tsay
    Tianhe Wang
    Guy Avraham
    Sabrina J. Abram
    Katinka van der Kooij
    Jeroen B. J. Smeets
    Richard B. Ivry
    [J]. Experimental Brain Research, 2023, 241 : 2287 - 2298