Dopaminergic genes are associated with both directed and random exploration

被引:25
|
作者
Gershman, Samuel J. [1 ,2 ]
Tzovaras, Bastian Greshake [3 ]
机构
[1] Harvard Univ, Dept Psychol, 52 Oxford St,Room 295-05, Cambridge, MA 02138 USA
[2] Harvard Univ, Ctr Brain Sci, 52 Oxford St,Room 295-05, Cambridge, MA 02138 USA
[3] Lawrence Berkeley Natl Lab, Berkeley, CA USA
关键词
Explore-exploit dilemma; Reinforcement learning; Bayesian inference; PREFRONTAL CORTEX; POLYMORPHISM;
D O I
10.1016/j.neuropsychologia.2018.10.009
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
In order to maximize long-term rewards, agents must balance exploitation (choosing the option with the highest payoff) and exploration (gathering information about options that might have higher payoffs). Although the optimal solution to this trade-off is intractable, humans make use of two effective strategies: selectively exploring options with high uncertainty (directed exploration), and increasing the randomness of their choices when they are more uncertain (random exploration). Using a task that independently manipulates these two forms of exploration, we show that single nucleotide polymorphisms related to dopamine are associated with individual differences in exploration strategies. Variation in a gene linked to prefrontal dopamine (COMT) predicted the degree of directed exploration, as well as the overall randomness of responding. Variation in a gene linked to striatal dopamine (DARPP-32) predicted the degree of both directed and random exploration. These findings suggest that dopamine makes multiple contributions to exploration, depending on its afferent target.
引用
收藏
页码:97 / 104
页数:8
相关论文
共 50 条
  • [1] Temporal discounting correlates with directed exploration but not with random exploration
    Sadeghiyeh, Hashem
    Wang, Siyu
    Alberhasky, Maxwell R.
    Kyllo, Hannah M.
    Shenhav, Amitai
    Wilson, Robert C.
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [2] Temporal discounting correlates with directed exploration but not with random exploration
    Hashem Sadeghiyeh
    Siyu Wang
    Maxwell R. Alberhasky
    Hannah M. Kyllo
    Amitai Shenhav
    Robert C. Wilson
    [J]. Scientific Reports, 10
  • [3] Development of directed and random exploration in children
    Meder, Bjorn
    Wu, Charley M.
    Schulz, Eric
    Ruggeri, Azzurra
    [J]. DEVELOPMENTAL SCIENCE, 2021, 24 (04)
  • [4] The effect of atomoxetine on random and directed exploration in humans
    Warren, Christopher M.
    Wilson, Robert C.
    van der Wee, Nic J.
    Giltay, Eric J.
    van Noorden, Martijn S.
    Cohen, Jonathan D.
    Nieuwenhuis, Sander
    [J]. PLOS ONE, 2017, 12 (04):
  • [5] A causal role for right frontopolar cortex in directed, but not random, exploration
    Zajkowski, Wojciech K.
    Kossut, Malgorzata
    Wilson, Robert C.
    [J]. ELIFE, 2017, 6
  • [6] Differential Impacts of Healthy Cognitive Aging on Directed and Random Exploration
    Mizell, Jack-Morgan
    Wang, Siyu
    Frisvold, Alec
    Alvarado, Lily
    Farrell-Skupny, Alex
    Keung, Waitsang
    Phelps, Caroline E.
    Sundman, Mark H.
    Franchetti, Mary-Kathryn
    Chou, Ying-hui
    Alexander, Gene E.
    Wilson, Robert C.
    [J]. PSYCHOLOGY AND AGING, 2024, 39 (01) : 88 - 101
  • [7] Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation
    Michael J Frank
    Bradley B Doll
    Jen Oas-Terpstra
    Francisco Moreno
    [J]. Nature Neuroscience, 2009, 12 : 1062 - 1068
  • [8] Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation
    Frank, Michael J.
    Doll, Bradley B.
    Oas-Terpstra, Jen
    Moreno, Francisco
    [J]. NATURE NEUROSCIENCE, 2009, 12 (08) : 1062 - U145
  • [9] Increased random exploration in schizophrenia is associated with inflammation
    Flurin Cathomas
    Federica Klaus
    Karoline Guetter
    Hui-Kuan Chung
    Anjali Raja Beharelle
    Tobias R. Spiller
    Rebecca Schlegel
    Erich Seifritz
    Matthias N. Hartmann-Riemer
    Philippe N. Tobler
    Stefan Kaiser
    [J]. npj Schizophrenia, 7
  • [10] Increased random exploration in schizophrenia is associated with inflammation
    Cathomas, Flurin
    Klaus, Federica
    Guetter, Karoline
    Chung, Hui-Kuan
    Beharelle, Anjali Raja
    Spiller, Tobias R.
    Schlegel, Rebecca
    Seifritz, Erich
    Hartmann-Riemer, Matthias N.
    Tobler, Philippe N.
    Kaiser, Stefan
    [J]. NPJ SCHIZOPHRENIA, 2021, 7 (01):