Random-walk model to study cycles emerging from the exploration-exploitation trade-off

被引:6
|
作者
Kazimierski, Laila D. [1 ]
Abramson, Guillermo
Kuperman, Marcelo N.
机构
[1] Consejo Nacl Invest Cient & Tecn, Ctr Atom Bariloche, San Carlos De Bariloche, Rio Negro, Argentina
关键词
SPACE USE; HOME; MOVEMENT;
D O I
10.1103/PhysRevE.91.012124
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
We present a model for a random walk with memory, phenomenologically inspired in a biological system. The walker has the capacity to remember the time of the last visit to each site and the step taken from there. This memory affects the behavior of the walker each time it reaches an already visited site modulating the probability of repeating previous moves. This probability increases with the time elapsed from the last visit. A biological analog of the walker is a frugivore, with the lattice sites representing plants. The memory effect can be associated with the time needed by plants to recover its fruit load. We propose two different strategies, conservative and explorative, as well as intermediate cases, leading to nonintuitive interesting results, such as the emergence of cycles.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Exploration - exploitation trade-off features a saltatory search behaviour
    Volchenkov, Dimitri
    Helbach, Jonathan
    Tscherepanow, Marko
    Kuehnel, Sina
    [J]. JOURNAL OF THE ROYAL SOCIETY INTERFACE, 2013, 10 (85)
  • [32] The Exploration/Exploitation Trade-off in Reinforcement Learning for Dialogue Management
    Varges, Sebastian
    Riccardi, Giuseppe
    Quarteroni, Silvia
    Ivanov, Alexei V.
    [J]. 2009 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION & UNDERSTANDING (ASRU 2009), 2009, : 479 - 484
  • [33] The trade-off between knowledge exploration and exploitation in technological innovation
    Li, Dehong
    Lin, Jun
    Cui, Wentian
    Qian, Yanjun
    [J]. JOURNAL OF KNOWLEDGE MANAGEMENT, 2018, 22 (04) : 781 - 801
  • [34] A Project Portfolio Management Approach to Tackling the Exploration/Exploitation Trade-off
    Linhart, Alexander
    Roeglinger, Maximilian
    Stelzl, Katharina
    [J]. BUSINESS & INFORMATION SYSTEMS ENGINEERING, 2020, 62 (02) : 103 - 119
  • [35] A Project Portfolio Management Approach to Tackling the Exploration/Exploitation Trade-off
    Alexander Linhart
    Maximilian Röglinger
    Katharina Stelzl
    [J]. Business & Information Systems Engineering, 2020, 62 : 103 - 119
  • [36] On the Exploration and Exploitation Trade-off in Cooperative Caching-enabled Networks
    Bommaraveni, Srikanth
    Gautam, Sumit
    Vu, Thang X.
    Chatzinotas, Symeon
    [J]. 2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2021,
  • [37] Bifurcation angles in ant foraging networks: A trade-off between exploration and exploitation?
    Berthouze, Luc
    Lorenzi, Alexander
    [J]. FROM ANIMALS TO ANIMATS 10, PROCEEDINGS, 2008, 5040 : 113 - 122
  • [38] Studying Exploitation and Exploration Trade-Off of Cognitive Odour-Guided Search
    Magalhaes, Hugo
    Baptista, Rui
    Marques, Lino
    [J]. ROBOT 2023: SIXTH IBERIAN ROBOTICS CONFERENCE ADVANCES IN ROBOTICS, VOL 1, 2024, 976 : 193 - 206
  • [39] Fuzzy Control of Trade-Off between Exploration and Exploitation Properties of Evolutionary Algorithms
    Slowik, Adam
    [J]. HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PART I, 2011, 6678 : 59 - 66
  • [40] Dopaminergic modulation of the exploration/exploitation trade-off in human decision-making
    Chakroun, Karima
    Mathar, David
    Wiehler, Antonius
    Ganzer, Florian
    Peters, Jan
    [J]. ELIFE, 2020, 9 : 1 - 44