Motion Strategy Using Opponent Player's Serial Learning for Air-Hockey Robots

被引:1
|
作者
Fukuda, Shotaro [1 ]
Tadokoro, Koichiro [1 ]
Namiki, Akio [1 ]
机构
[1] Chiba Univ, Grad Sch Sci & Engn, Inage Ku, 1-33 Yayoicho, Chiba, Chiba 2638522, Japan
关键词
D O I
10.1109/IROS51168.2021.9635854
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, there have been many studies on sports robots that can play against humans, including studies on the strategies that sports robots use by taking into account the physical conditions of their opponents. However, there have been few studies on strategies that take into account psychological conditions of the opponents, such as carelessness and habituation. This paper proposes a motion strategy for an air-hockey robot that intentionally coaxes the opponent to learn the robot's attack sequence and then uses a different attack sequence to catch the opponent off guard. We explicitly model the change in reaction time during serial learning and represent the opponent's reaction as an evaluation function. By applying this evaluation function to a game tree and selecting the optimal motion, the robot could catch the opponent by surprise. Actual experiments with several subjects confirmed the effectiveness of the proposed method.
引用
收藏
页码:952 / 957
页数:6
相关论文
共 50 条
  • [1] A Decision-Making Algorithm for an Air-Hockey Robot that Decides Actions Depending on its Opponent Player's Motions
    Igeta, Kazuki
    Namiki, Akio
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2015, : 1840 - 1845
  • [2] Air Hockey Player Motion Learning Using PPO Model Reinforcement Learning
    Moon, Seonguk
    Cho, Youngwan
    Transactions of the Korean Institute of Electrical Engineers, 2024, 73 (12): : 2341 - 2349
  • [3] Real-time Player's Posture Measurement System for Air-Hockey Robot
    Kaneko, Masaya
    Namiki, Akio
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2018, : 1353 - 1358
  • [4] Poker playing system considering opponent player's strategy
    Onisawa, T. (onisawa@esys.tsukuba.ac.jp), Society of Instrument and Control Engineers, (SICE); IEEE Industrial Electronics Society; IEEE Robotics and Automation Society; IEEE Control Systems Society; IEEE Systems, Man and Cybernetics Society (Society of Instrument and Control Engineers (SICE)):
  • [5] Poker playing system considering opponent player's strategy
    Onisawa, T
    Takahashi, C
    SICE 2004 ANNUAL CONFERENCE, VOLS 1-3, 2004, : 2347 - 2352
  • [6] Game Player Strategy Pattern Recognition and How UCT Algorithms Apply Pre-Knowledge of Player's Strategy to Improve Opponent AI
    He, Suoju
    Wang, Yi
    Xie, Fan
    Meng, Jin
    Chen, Hongtao
    Luo, Sai
    Liu, Zhiqing
    Zhu, Qiliang
    2008 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE FOR MODELLING CONTROL & AUTOMATION, VOLS 1 AND 2, 2008, : 1177 - 1181
  • [7] Learning Control for Air Hockey Striking using Deep Reinforcement Learning
    Taitler, Ayal
    Shimkin, Nahum
    2017 INTERNATIONAL CONFERENCE ON CONTROL, ARTIFICIAL INTELLIGENCE, ROBOTICS & OPTIMIZATION (ICCAIRO), 2017, : 22 - 27
  • [8] Using online learning to analyze the opponent's behavior
    Visser, U
    Weland, HG
    ROBOCUP 2002: ROBOT SOCCER WORLD CUP VI, 2003, 2752 : 78 - 93
  • [9] A Real-time Velocity Estimation using Motion Blur in Air Hockey
    Rezvankhah, Sh.
    Bagherzadeh, A. A.
    Moradi, H.
    Araabi, B. Nadjar
    2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO 2012), 2012,
  • [10] Motion Planning for Industrial Robots using Reinforcement Learning
    Meyes, Richard
    Tercan, Hasan
    Roggendorf, Simon
    Thiele, Thomas
    Buescher, Christian
    Obdenbusch, Markus
    Brecher, Christian
    Jeschke, Sabina
    Meisen, Tobias
    MANUFACTURING SYSTEMS 4.0, 2017, 63 : 107 - 112