Time-Based Reward Shaping in Real-Time Strategy Games

被引:0
|
作者
Midtgaard, Martin [1 ]
Vinther, Lars [1 ]
Christiansen, Jeppe R. [1 ]
Christensen, Allan M. [1 ]
Zeng, Yifeng [1 ]
机构
[1] Aalborg Univ, Aalborg, Denmark
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-Time Strategy (RTS) is a challenging domain for AI, since it involves not only a large state space, but also dynamic actions that agents execute concurrently. This problem cannot be optimally solved through general Q-learning techniques, so we propose a solution using a Semi Markov Decision Process (SMDP). We present a time-based reward shaping technique, TRS, to speed up the learning process in reinforcement learning. Especially, we show that our technique preserves the solution optimality for some SMDP problems. We evaluate the performance of our method in the Spring game Balanced Annihilation, and provide some benchmarks showing the performance of our approach.
引用
收藏
页码:115 / 125
页数:11
相关论文
共 50 条
  • [1] Learning in Real-time Strategy Games
    Padmanabhan, Vineet
    Goud, Pranay
    Pujari, Arun K.
    Sethy, Harshit
    [J]. 2015 14TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY (ICIT 2015), 2015, : 165 - 170
  • [2] Real-time plan adaptation for case-based planning in real-time strategy games
    Sugandh, Neha
    Ontanon, Santiago
    Ram, Ashwin
    [J]. ADVANCES IN CASE-BASED REASONING, PROCEEDINGS, 2008, 5239 : 533 - 547
  • [3] Opponent modeling in real-time strategy games
    Schadd, Frederik
    Bakkes, Sander
    Sprouck, Pieter
    [J]. GAME-ON 2007: 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT GAMES AND SIMULATION, 2007, : 61 - 68
  • [4] Programmatic Strategies for Real-Time Strategy Games
    Marino, Julian R. H.
    Moraes, Rubens O.
    Oliveira, Tassiana C.
    Toledo, Claudio
    Lelis, Levi H. S.
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 381 - 389
  • [5] Interfacing Agents to Real-Time Strategy Games
    Jensen, Andreas Schmidt
    Kayso-Rordam, Christian
    Villadsen, Jorgen
    [J]. THIRTEENTH SCANDINAVIAN CONFERENCE ON ARTIFICIAL INTELLIGENCE (SCAI 2015), 2015, 278 : 68 - 77
  • [6] Dynamic Formations in Real-Time Strategy Games
    van der Heijden, Marcel
    Bakkes, Sander
    Spronck, Pieter
    [J]. 2008 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND GAMES, 2008, : 47 - 54
  • [7] An abstract model for real-time strategy games
    Keaveney, David
    O'Riordan, Colm
    [J]. PROCEEDINGS OF CGAMES'2007: 11TH INTERNATIONAL CONFERENCE ON COMPUTER GAMES: AI, ANIMATION, MOBILE, EDUCATIONAL AND SERIOUS GAMES, 2007, 2007, : 61 - 65
  • [8] Guest Editorial Real-Time Strategy Games
    Buro, Michael
    Ontanon, Santiago
    Preuss, Mike
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2016, 8 (04) : 317 - 318
  • [9] Evolving Coordination for Real-Time Strategy Games
    Keaveney, David
    O'Riordan, Colm
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2011, 3 (02) : 155 - 167
  • [10] PATH CACHING IN REAL-TIME STRATEGY GAMES
    Saenen, Ignace Pieter
    Khalil, Jonas El Sayeh
    Lambert, Peter
    Van de Walle, Rik
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCES ON INTERFACES AND HUMAN COMPUTER INTERACTION 2015, GAME AND ENTERTAINMENT TECHNOLOGIES 2015 AND COMPUTER GRAPHICS, VISUALIZATION, COMPUTER VISION AND IMAGE PROCESSING 2015, 2015, : 147 - 154