Adapation of Iterated Prisoner's Dilemma strategies by evolution and learning

被引:4
|
作者
Quek, Han Yang [1 ]
Goh, Chi Keong [1 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117548, Singapore
关键词
evolution; incremental learning; memetic algorithm; Iterated Prisoner's Dilemma;
D O I
10.1109/CIG.2007.368077
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper examines the performance and adaptability of evolutionary, learning and memetic strategies to different environment settings in the Iterated Prisoner's Dilemma (IPD). A memetic adaptation framework is devised for IPD strategies to exploit the complementary features of evolution and learning. In the paradigm, learning serves as a form of directed search to guide evolutionary strategies to attain good strategy traits while evolution helps to minimize disparity in performance between learning strategies. A cognitive double-loop incremental learning scheme (ILS) that encompasses a perception component, probabilistic revision of strategies and a feedback learning mechanism is also proposed and incorporated into evolution. Simulation results verify that the two techniques, when employed together, are able to complement each other's strengths and compensate each other's weaknesses, leading to the formation of good strategies that adapt and thrive well in complex, dynamic environments.
引用
收藏
页码:40 / 47
页数:8
相关论文
共 50 条
  • [1] Evolution and Incremental Learning in the Iterated Prisoner's Dilemma
    Quek, Han-Yang
    Tan, Kay Chen
    Goh, Chi-Keong
    Abbass, Hussein A.
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2009, 13 (02) : 303 - 320
  • [2] Learning versus evolution in iterated prisoner's dilemma
    Hingston, P
    Kendall, G
    [J]. CEC2004: PROCEEDINGS OF THE 2004 CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1 AND 2, 2004, : 364 - 372
  • [3] Evolution of Cooperative Strategies for Iterated Prisoner's Dilemma on Networks
    Ishibuchi, Hisao
    Sudo, Takahiko
    Hoshino, Koichiro
    Nojima, Yusuke
    [J]. 2013 FIFTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL ASPECTS OF SOCIAL NETWORKS (CASON), 2013, : 32 - 37
  • [4] Critical Dynamics in the Evolution of Stochastic Strategies for the Iterated Prisoner's Dilemma
    Iliopoulos, Dimitris
    Hintze, Arend
    Adami, Christoph
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2010, 6 (10)
  • [5] A Differential Evolution Algorithm to Develop Strategies for the Iterated Prisoner's Dilemma
    Rigakis, Manousos
    Trachanatzi, Dimitra
    Marinaki, Magdalene
    Marinakis, Yannis
    [J]. MACHINE LEARNING, OPTIMIZATION, AND BIG DATA, MOD 2017, 2018, 10710 : 133 - 145
  • [6] Stationary strategies in iterated prisoner's dilemma
    Levchenkov V.S.
    Levchenkova L.G.
    [J]. Computational Mathematics and Modeling, 2006, 17 (3) : 254 - 273
  • [7] Shopkeeper Strategies in the Iterated Prisoner's Dilemma
    Ashlock, Daniel
    Kuusela, Christopher
    Cojocaru, Monica
    [J]. 2011 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2011, : 1063 - 1070
  • [8] Invincible Strategies of Iterated Prisoner's Dilemma
    Wang, Shiheng
    Lin, Fangzhen
    [J]. AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 2256 - 2258
  • [9] Reinforcement learning produces dominant strategies for the Iterated Prisoner's Dilemma
    Harper, Marc
    Knight, Vincent
    Jones, Martin
    Koutsovoulos, Georgios
    Glynatsi, Nikoleta E.
    Campbell, Owen
    [J]. PLOS ONE, 2017, 12 (12):
  • [10] PREFERENCE AND EVOLUTION IN THE ITERATED PRISONER’S DILEMMA
    王先甲
    刘伟兵
    [J]. Acta Mathematica Scientia, 2009, (02) : 456 - 464