Dopaminergic genes are associated with both directed and random exploration

被引:25
|
作者
Gershman, Samuel J. [1 ,2 ]
Tzovaras, Bastian Greshake [3 ]
机构
[1] Harvard Univ, Dept Psychol, 52 Oxford St,Room 295-05, Cambridge, MA 02138 USA
[2] Harvard Univ, Ctr Brain Sci, 52 Oxford St,Room 295-05, Cambridge, MA 02138 USA
[3] Lawrence Berkeley Natl Lab, Berkeley, CA USA
关键词
Explore-exploit dilemma; Reinforcement learning; Bayesian inference; PREFRONTAL CORTEX; POLYMORPHISM;
D O I
10.1016/j.neuropsychologia.2018.10.009
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
In order to maximize long-term rewards, agents must balance exploitation (choosing the option with the highest payoff) and exploration (gathering information about options that might have higher payoffs). Although the optimal solution to this trade-off is intractable, humans make use of two effective strategies: selectively exploring options with high uncertainty (directed exploration), and increasing the randomness of their choices when they are more uncertain (random exploration). Using a task that independently manipulates these two forms of exploration, we show that single nucleotide polymorphisms related to dopamine are associated with individual differences in exploration strategies. Variation in a gene linked to prefrontal dopamine (COMT) predicted the degree of directed exploration, as well as the overall randomness of responding. Variation in a gene linked to striatal dopamine (DARPP-32) predicted the degree of both directed and random exploration. These findings suggest that dopamine makes multiple contributions to exploration, depending on its afferent target.
引用
收藏
页码:97 / 104
页数:8
相关论文
共 50 条
  • [31] Exploration and validation of metastasis-associated genes for skin cutaneous melanoma
    Hong Luan
    Linge Jian
    Ye He
    Tuo Zhang
    Liping Zhou
    [J]. Scientific Reports, 12
  • [32] Exploration and validation of metastasis-associated genes for skin cutaneous melanoma
    Luan, Hong
    Jian, Linge
    He, Ye
    Zhang, Tuo
    Su, Yanna
    Zhou, Liping
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [33] Analysis of Genes Associated with Both Neural Tube Defects and Neuroectodermal Tumors
    Cao, Rui
    Li, Jiaqi
    Zhang, Li
    Li, Jianting
    Liang, Yuxiang
    Ao, Ruifang
    Wang, Ying
    Li, Hang
    Lu, Xin
    Liu, Zhizhen
    Zhao, Hong
    Xie, Jun
    [J]. MEDICAL SCIENCE MONITOR, 2022, 28
  • [34] BOTH RANDOM AND GUIDED
    van Woudenberg, R.
    Rothuizen-van der Steen, J.
    [J]. RATIO, 2015, 28 (03) : 332 - 348
  • [35] Directed random walk with random restarts: The Sisyphus random walk
    Montero, Miquel
    Villarroel, Javier
    [J]. PHYSICAL REVIEW E, 2016, 94 (03)
  • [36] Directed Differentiation of Embryonic Stem Cells Allows Exploration of Novel Transcription Factor Genes for Pancreas Development
    Jing Sui
    Munish Mehta
    Bingyin Shi
    Grant Morahan
    Fang-Xu Jiang
    [J]. Stem Cell Reviews and Reports, 2012, 8 : 803 - 812
  • [37] Directed Differentiation of Embryonic Stem Cells Allows Exploration of Novel Transcription Factor Genes for Pancreas Development
    Sui, Jing
    Mehta, Munish
    Shi, Bingyin
    Morahan, Grant
    Jiang, Fang-Xu
    [J]. STEM CELL REVIEWS AND REPORTS, 2012, 8 (03) : 803 - 812
  • [38] From dopaminergic genes to psychiatric disorders
    Hoenicka, Janet
    Araguees, Maria
    Ponce, Guillermo
    Rodriguez-Jimenez, Roberto
    Jimenez-Arriero, Miguel A.
    Palomo, Tomas
    [J]. NEUROTOXICITY RESEARCH, 2007, 11 (01) : 61 - 71
  • [39] Enhancing selection of alcohol consumption-associated genes by random forest
    Lyu, Chenglin
    Joehanes, Roby
    Huan, Tianxiao
    Levy, Daniel
    Li, Yi
    Wang, Mengyao
    Liu, Xue
    Liu, Chunyu
    Ma, Jiantao
    [J]. BRITISH JOURNAL OF NUTRITION, 2024, 131 (12) : 2049 - 2057
  • [40] From dopaminergic genes to psychiatric disorders
    Janet Hoenicka
    María aragüés
    Guillermo Ponce
    Roberto Rodríguez-Jiménez
    Miguel A. Jiménez-Arriero
    Tomás Palomo
    [J]. Neurotoxicity Research, 2007, 11 : 61 - 71