Motion Strategy Using Opponent Player's Serial Learning for Air-Hockey Robots

被引:1
|
作者
Fukuda, Shotaro [1 ]
Tadokoro, Koichiro [1 ]
Namiki, Akio [1 ]
机构
[1] Chiba Univ, Grad Sch Sci & Engn, Inage Ku, 1-33 Yayoicho, Chiba, Chiba 2638522, Japan
关键词
D O I
10.1109/IROS51168.2021.9635854
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, there have been many studies on sports robots that can play against humans, including studies on the strategies that sports robots use by taking into account the physical conditions of their opponents. However, there have been few studies on strategies that take into account psychological conditions of the opponents, such as carelessness and habituation. This paper proposes a motion strategy for an air-hockey robot that intentionally coaxes the opponent to learn the robot's attack sequence and then uses a different attack sequence to catch the opponent off guard. We explicitly model the change in reaction time during serial learning and represent the opponent's reaction as an evaluation function. By applying this evaluation function to a game tree and selecting the optimal motion, the robot could catch the opponent by surprise. Actual experiments with several subjects confirmed the effectiveness of the proposed method.
引用
收藏
页码:952 / 957
页数:6
相关论文
共 50 条
  • [21] Continuous Motion Planning for Mobile Robots Using Fuzzy Deep Reinforcement Learning
    Wu, Fenghua
    Tang, Wenbing
    Zhou, Yuan
    Lin, Shang-Wei
    Liu, Yang
    Ding, Zuohua
    2024 WRC SYMPOSIUM ON ADVANCED ROBOTICS AND AUTOMATION, WRC SARA, 2024, : 15 - 21
  • [22] Hierarchical Free Gait Motion Planning for Hexapod Robots Using Deep Reinforcement Learning
    Wang, Xinpeng
    Fu, Huiqiao
    Deng, Guizhou
    Liu, Canghai
    Tang, Kaiqiang
    Chen, Chunlin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 10901 - 10912
  • [23] Motion Planning for 2-DOF Transformable Wheel Robots Using Reinforcement Learning
    Park, Inha
    Ryu, Sijun
    Won, Jeeho
    Yoon, Hyeungyu
    Kim, SangGyun
    Kim, Hwa Soo
    Seo, TaeWon
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 10193 - 10200
  • [24] Learn Like Infants: A Strategy for Developmental Learning of Symbolic Skills Using Humanoid Robots
    Kun Li
    Max Q.-H. Meng
    International Journal of Social Robotics, 2015, 7 : 439 - 450
  • [25] Learn Like Infants: A Strategy for Developmental Learning of Symbolic Skills Using Humanoid Robots
    Li, Kun
    Meng, Max Q. -H.
    INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2015, 7 (04) : 439 - 450
  • [26] Kicking Motion Design of Humanoid Robots Using Gradual Accumulation Learning Method Based on Q-learning
    Wang, Jiawen
    Liang, Zhiwei
    Zhou, Zixuan
    Zhang, Yunfei
    PROCEEDINGS OF THE 28TH CHINESE CONTROL AND DECISION CONFERENCE (2016 CCDC), 2016, : 5274 - 5279
  • [27] Player's Performance Prediction in ODI Cricket Using Machine Learning Algorithms
    Anik, Aminul Islam
    Yeaser, Sakif
    Hossain, A. G. M. Imam
    Chakrabarty, Amitabha
    2018 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION & COMMUNICATION TECHNOLOGY (ICEEICT), 2018, : 499 - 504
  • [28] Air-Combat Strategy Using Deep Q-Learning
    Ma, Xiaoteng
    Xia, Li
    Zhao, Qianchuan
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 3952 - 3957
  • [29] AN ITERATIVE LEARNING SCHEME FOR MOTION CONTROL OF ROBOTS USING NEURAL NETWORKS - A CASE-STUDY
    FU, JG
    SINHA, NK
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 1993, 8 (03) : 375 - 398
  • [30] A Motion Generation Strategy of Robotic Rat Using Imitation Learning for Behavioral Interaction
    Xie, Hongzhao
    Jia, Guanglu
    Al-Khulaqui, Mohamed
    Gao, Zihang
    Guo, Xiaowen
    Fukuda, Toshio
    Shi, Qing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03): : 7351 - 7358