Modeling Avoidance in Mood and Anxiety Disorders Using Reinforcement Learning

被引:72
|
作者
Mkrtchian, Anahit [1 ]
Aylward, Jessica [1 ]
Dayan, Peter [2 ]
Roiser, Jonathan P. [1 ]
Robinson, Oliver J. [1 ]
机构
[1] UCL, Inst Cognit Neurosci, 17 Queen Sq, London WC1N 3AZ, England
[2] UCL, Gatsby Computat Neurosci Unit, London, England
基金
英国医学研究理事会;
关键词
Anxiety; Avoidance; Diathesis-stress; Pavlovian bias; Reinforcement learning; Threat of shock; BEHAVIORAL-INHIBITION; REWARD; PUNISHMENT; REPRESENTATIONS; NEUROSCIENCE; STRIATUM; HUMANS; THREAT; TASK; GO;
D O I
10.1016/j.biopsych.2017.01.017
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
BACKGROUND: Serious and debilitating symptoms of anxiety are the most common mental health problem worldwide, accounting for around 5% of all adult years lived with disability in the developed world. Avoidance behavior-avoiding social situations for fear of embarrassment, for instance-is a core feature of such anxiety. However, as for many other psychiatric symptoms the biological mechanisms underlying avoidance remain unclear. METHODS: Reinforcement learning models provide formal and testable characterizations of the mechanisms of decision making; here, we examine avoidance in these terms. A total of 101 healthy participants and individuals with mood and anxiety disorders completed an approach-avoidance go/ no-go task under stress induced by threat of unpredictable shock. RESULTS: We show an increased reliance in the mood and anxiety group on a parameter of our reinforcement learning model that characterizes a prepotent (pavlovian) bias to withhold responding in the face of negative outcomes. This was particularly the case when the mood and anxiety group was under stress. CONCLUSIONS: This formal description of avoidance within the reinforcement learning framework provides a new means of linking clinical symptoms with biophysically plausible models of neural circuitry and, as such, takes us closer to a mechanistic understanding of mood and anxiety disorders.
引用
收藏
页码:532 / 539
页数:8
相关论文
共 50 条
  • [1] Aircraft collision avoidance modeling and optimization using deep reinforcement learning
    Park K.-W.
    Kim J.-H.
    [J]. Journal of Institute of Control, Robotics and Systems, 2021, 27 (09) : 652 - 659
  • [2] Reinforcement learning models of aversive learning and their translation to anxiety disorders
    Seymour, Ben
    Norbury, Agnes
    [J]. JOURNAL OF NEURAL TRANSMISSION, 2017, 124 (10) : 1283 - 1284
  • [3] Reinforcement Learning in Patients With Mood and Anxiety Disorders vs Control Individuals A Systematic Review and Meta-analysis
    Pike, Alexandra C.
    Robinson, Oliver J.
    [J]. JAMA PSYCHIATRY, 2022, 79 (04) : 313 - 322
  • [4] Using Machine Learning to Characterize Circuit-Based Subtypes in Mood and Anxiety Disorders
    Young, Christina
    Harati, Sahar
    Ball, Tali
    Williams, Leanne
    [J]. BIOLOGICAL PSYCHIATRY, 2019, 85 (10) : S310 - S310
  • [5] Optimization of Obstacle Avoidance Using Reinforcement Learning
    Kominami, Keishi
    Takubo, Tomohito
    Ohara, Kenichi
    Mae, Yasushi
    Arai, Tatsuo
    [J]. 2012 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2012, : 67 - 72
  • [6] Impaired probabilistic reversal learning in youths with mood and anxiety disorders
    Dickstein, D. P.
    Finger, E. C.
    Brotman, M. A.
    Rich, B. A.
    Pine, D. S.
    Blair, J. R.
    Leibenluft, E.
    [J]. PSYCHOLOGICAL MEDICINE, 2010, 40 (07) : 1089 - 1100
  • [7] Altered learning under uncertainty in unmedicated mood and anxiety disorders
    Jessica Aylward
    Vincent Valton
    Woo-Young Ahn
    Rebecca L. Bond
    Peter Dayan
    Jonathan P. Roiser
    Oliver J. Robinson
    [J]. Nature Human Behaviour, 2019, 3 : 1116 - 1123
  • [8] Altered learning under uncertainty in unmedicated mood and anxiety disorders
    Aylward, Jessica
    Valton, Vincent
    Ahn, Woo-Young
    Bond, Rebecca L.
    Dayan, Peter
    Roiser, Jonathan P.
    Robinson, Oliver J.
    [J]. NATURE HUMAN BEHAVIOUR, 2019, 3 (10) : 1116 - 1123
  • [9] An integrated review of fear and avoidance learning in anxiety disorders and application to eating disorders
    Christian, Caroline
    Levinson, Cheri A.
    [J]. NEW IDEAS IN PSYCHOLOGY, 2022, 67
  • [10] Approach-avoidance reinforcement learning as a translational and computational model of anxiety-related avoidance
    Yamamori, Yumeya
    Robinson, Oliver J.
    Roiser, Jonathan P.
    [J]. ELIFE, 2023, 12