Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

被引:18
|
作者
Ognibene, Dimitri [1 ,2 ]
Fiore, Vincenzo G. [3 ]
Gu, Xiaosi [3 ,4 ,5 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester, Essex, England
[2] Univ Pompeu Fabra, ETIC, Barcelona, Spain
[3] Icahn Sch Med Mt Sinai, Dept Psychiat, New York, NY 10029 USA
[4] Icahn Sch Med Mt Sinai, Nash Family Dept Neurosci, New York, NY 10029 USA
[5] James J Peter Vet Affairs Med Ctr, Mental Illness Res Educ & Clin Ctr, MIRECC VISN 2, Bronx, NY USA
基金
欧盟地平线“2020”;
关键词
Addiction; Reinforcement learning; Computational psychiatry; Gambling; Internet gaming; Bounded rationality; Exploration-exploitation; DRUG-ADDICTION; DECISION-MAKING; LEARNING-MODELS; SOCIAL-CONTEXT; REINFORCEMENT; REWARD; DOPAMINE; HABITS; MECHANISMS; RELAPSE;
D O I
10.1016/j.neunet.2019.04.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:269 / 278
页数:10
相关论文
共 50 条