Random-walk model to study cycles emerging from the exploration-exploitation trade-off

被引:6
|
作者
Kazimierski, Laila D. [1 ]
Abramson, Guillermo
Kuperman, Marcelo N.
机构
[1] Consejo Nacl Invest Cient & Tecn, Ctr Atom Bariloche, San Carlos De Bariloche, Rio Negro, Argentina
关键词
SPACE USE; HOME; MOVEMENT;
D O I
10.1103/PhysRevE.91.012124
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
We present a model for a random walk with memory, phenomenologically inspired in a biological system. The walker has the capacity to remember the time of the last visit to each site and the step taken from there. This memory affects the behavior of the walker each time it reaches an already visited site modulating the probability of repeating previous moves. This probability increases with the time elapsed from the last visit. A biological analog of the walker is a frugivore, with the lattice sites representing plants. The memory effect can be associated with the time needed by plants to recover its fruit load. We propose two different strategies, conservative and explorative, as well as intermediate cases, leading to nonintuitive interesting results, such as the emergence of cycles.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Uncertainty avoidance and the exploration-exploitation trade-off
    Broekhuizen, Thijs L. J.
    Giarratana, Marco S.
    Torres, Anna
    [J]. EUROPEAN JOURNAL OF MARKETING, 2017, 51 (11-12) : 2080 - 2100
  • [2] Uncertainty quantification and exploration-exploitation trade-off in humans
    Candelieri, Antonio
    Ponti, Andrea
    Archetti, Francesco
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 14 (6) : 6843 - 6876
  • [3] Exploration-exploitation Trade-off in a Treasure Hunting Game
    Volchenkov, Dimitri
    Helbach, Jonathan
    Tscherepanow, Marko
    Kueheel, Sina
    [J]. ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2013, 299 : 101 - 121
  • [4] The Exploration-Exploitation Trade-off in Interactive Recommender Systems
    Barraza-Urbina, Andrea
    [J]. PROCEEDINGS OF THE ELEVENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS'17), 2017, : 431 - 435
  • [5] The role of the noradrenergic system in the exploration-exploitation trade-off: a psychopharmacological study
    Jepma, Marieke
    Beek, Erik T. Te
    Wagenmakers, Eric-Jan
    van Gerven, Joop M. A.
    Nieuwenhuis, Sander
    [J]. FRONTIERS IN HUMAN NEUROSCIENCE, 2010, 4
  • [6] Dopamine blockade impairs the exploration-exploitation trade-off in rats
    François Cinotti
    Virginie Fresno
    Nassim Aklil
    Etienne Coutureau
    Benoît Girard
    Alain R. Marchand
    Mehdi Khamassi
    [J]. Scientific Reports, 9
  • [7] Dopamine blockade impairs the exploration-exploitation trade-off in rats
    Cinotti, Francois
    Fresno, Virginie
    Aklil, Nassim
    Coutureau, Etienne
    Girard, Benoit
    Marchand, Alain R.
    Khamassi, Mehdi
    [J]. SCIENTIFIC REPORTS, 2019, 9 (1)
  • [8] Energetic state regulates the exploration-exploitation trade-off in honeybees
    Katz, Keziah
    Naug, Dhruba
    [J]. BEHAVIORAL ECOLOGY, 2015, 26 (04) : 1045 - 1050
  • [9] The implied exploration-exploitation trade-off in human motor learning
    Holly N Phillips
    Nikhil A Howai
    Guy-Bart V Stan
    Aldo A Faisal
    [J]. BMC Neuroscience, 12 (Suppl 1)
  • [10] Dynamic Sparse Training via Balancing the Exploration-Exploitation Trade-off
    Huang, Shaoyi
    Lei, Bowen
    Xu, Dongkuan
    Peng, Hongwu
    Sun, Yue
    Xie, Mimi
    Ding, Caiwen
    [J]. 2023 60TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC, 2023,