Addiction beyond pharmacological effects: The role of environment complexity and bounded rationality

被引:18
|
作者
Ognibene, Dimitri [1 ,2 ]
Fiore, Vincenzo G. [3 ]
Gu, Xiaosi [3 ,4 ,5 ]
机构
[1] Univ Essex, Sch Comp Sci & Elect Engn, Colchester, Essex, England
[2] Univ Pompeu Fabra, ETIC, Barcelona, Spain
[3] Icahn Sch Med Mt Sinai, Dept Psychiat, New York, NY 10029 USA
[4] Icahn Sch Med Mt Sinai, Nash Family Dept Neurosci, New York, NY 10029 USA
[5] James J Peter Vet Affairs Med Ctr, Mental Illness Res Educ & Clin Ctr, MIRECC VISN 2, Bronx, NY USA
基金
欧盟地平线“2020”;
关键词
Addiction; Reinforcement learning; Computational psychiatry; Gambling; Internet gaming; Bounded rationality; Exploration-exploitation; DRUG-ADDICTION; DECISION-MAKING; LEARNING-MODELS; SOCIAL-CONTEXT; REINFORCEMENT; REWARD; DOPAMINE; HABITS; MECHANISMS; RELAPSE;
D O I
10.1016/j.neunet.2019.04.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Several decision-making vulnerabilities have been identified as underlying causes for addictive behaviours, or the repeated execution of stereotyped actions despite their adverse consequences. These vulnerabilities are mostly associated with brain alterations caused by the consumption of substances of abuse. However, addiction can also happen in the absence of a pharmacological component, such as seen in pathological gambling and videogaming. We use a new reinforcement learning model to highlight a previously neglected vulnerability that we suggest interacts with those already identified, whilst playing a prominent role in non-pharmacological forms of addiction. Specifically, we show that a dual-learning system (i.e. combining model-based and model-free) can be vulnerable to highly rewarding, but suboptimal actions, that are followed by a complex ramification of stochastic adverse effects. This phenomenon is caused by the overload of the capabilities of an agent, as time and cognitive resources required for exploration, deliberation, situation recognition, and habit formation, all increase as a function of the depth and richness of detail of an environment. Furthermore, the cognitive overload can be aggravated due to alterations (e.g. caused by stress) in the bounded rationality, i.e. the limited amount of resources available for the model-based component, in turn increasing the agent's chances to develop or maintain addictive behaviours. Our study demonstrates that, independent of drug consumption, addictive behaviours can arise in the interaction between the environmental complexity and the biologically finite resources available to explore and represent it. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:269 / 278
页数:10
相关论文
共 50 条
  • [31] ON DISEQUILIBRIUM DYNAMICS AND THE MECHANISM OF PRODUCTIVITY GROWTH - IMPLICATIONS FOR THE ROLE OF BOUNDED RATIONALITY
    BAUMOL, WJ
    WOLFF, EN
    REVUE ECONOMIQUE, 1995, 46 (06): : 1391 - &
  • [32] The Role of Bounded Rationality in Farm Financing Decisions - First Empirical Evidence
    Musshoff, Oliver
    Hirschauer, Norbert
    Wassmuss, Harm
    BERICHTE UBER LANDWIRTSCHAFT, 2009, 87 (02): : 234 - 245
  • [33] Bounded Rationality, Uncertainty, and Complexity as Decision-Making Contexts: A Case of One University in Russia
    Drugova, Elena A.
    Kalachikova, Olga N.
    EUROPEAN JOURNAL OF CONTEMPORARY EDUCATION, 2019, 8 (04): : 738 - 750
  • [34] Complexity Analysis of a 3-Player Game with Bounded Rationality Participating in Nitrogen Emission Reduction
    Zhang, Jixiang
    Xi, Xuan
    COMPLEXITY, 2020, 2020
  • [35] Complexity and chaos control in a Cournot duopoly model based on bounded rationality and relative profit maximization
    Zhouchao Wei
    Wenhui Tan
    A. A. Elsadany
    Irene Moroz
    Nonlinear Dynamics, 2023, 111 : 17561 - 17589
  • [36] Complexity and chaos control in a Cournot duopoly model based on bounded rationality and relative profit maximization
    Wei, Zhouchao
    Tan, Wenhui
    Elsadany, A. A.
    Moroz, Irene
    NONLINEAR DYNAMICS, 2023, 111 (18) : 17561 - 17589
  • [37] Pharmacological and behavioral effects of added flavorants on tobacco addiction
    Wickham, Robert J.
    Henderson, Brandon J.
    Jackson, Asti B.
    Kabbani, Nadine
    FRONTIERS IN NEUROSCIENCE, 2022, 16
  • [38] Transnational Labour Law and the Environment: Beyond the Bounded Autonomous Worker
    Seck, Sara L.
    CANADIAN JOURNAL OF LAW AND SOCIETY, 2018, 33 (02): : 137 - 157
  • [39] Effects of Users' Bounded Rationality on a Traffic Network Performance: A Simulation Study
    Batista, S. F. A.
    Zhao, Chuan-Lin
    Leclercq, Ludovic
    JOURNAL OF ADVANCED TRANSPORTATION, 2018,
  • [40] Synaptic Plasticity: The Role of Learning and Unlearning in Addiction and Beyond
    Ramirez, Alejandro
    Arbuckle, Melissa R.
    BIOLOGICAL PSYCHIATRY, 2016, 80 (09) : E73 - E75