Table-Balancing Cooperative Robot Based on Deep Reinforcement Learning

被引:1
|
作者
Kim, Yewon [1 ]
Kim, Dae-Won [2 ]
Kang, Bo-Yeong [3 ]
机构
[1] Kyungpook Natl Univ, Dept Artificial Intelligence, Daegu 41566, South Korea
[2] Chung Ang Univ, Sch Comp Sci & Engn, 84 Heukseok Ro, Seoul 06974, South Korea
[3] Kyungpook Natl Univ, Dept Robot & Smart Syst Engn, Daegu 41566, South Korea
基金
新加坡国家研究基金会;
关键词
reinforcement learning; deep Q-network; cooperative robot; human-robot interaction; FRAMEWORK;
D O I
10.3390/s23115235
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Reinforcement learning is one of the artificial intelligence methods that enable robots to judge and operate situations on their own by learning to perform tasks. Previous reinforcement learning research has mainly focused on tasks performed by individual robots; however, everyday tasks, such as balancing tables, often require cooperation between two individuals to avoid injury when moving. In this research, we propose a deep reinforcement learning-based technique for robots to perform a table-balancing task in cooperation with a human. The cooperative robot proposed in this paper recognizes human behavior to balance the table. This recognition is achieved by utilizing the robot's camera to take an image of the state of the table, then the table-balance action is performed afterward. Deep Q-network (DQN) is a deep reinforcement learning technology applied to cooperative robots. As a result of learning table balancing, on average, the cooperative robot showed a 90% optimal policy convergence rate in 20 runs of training with optimal hyperparameters applied to DQN-based techniques. In the H/W experiment, the trained DQN-based robot achieved an operation precision of 90%, thus verifying its excellent performance.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Interactive Reinforcement Learning for Table Balancing Robot
    Jeon, Haein
    Kim, Yewon
    Kang, Boyeong
    [J]. SPLU-ROBONLP 2021: THE 2ND INTERNATIONAL COMBINED WORKSHOP ON SPATIAL LANGUAGE UNDERSTANDING AND GROUNDED COMMUNICATION FOR ROBOTICS, 2021, : 71 - 78
  • [2] Learning Ball-Balancing Robot through Deep Reinforcement Learning
    Zhou, Yifan
    Lin, Jianghao
    Wang, Shuai
    Zhang, Chong
    [J]. 2021 INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS (ICCCR 2021), 2021, : 1 - 8
  • [3] Hierarchical Human-robot Cooperative Control Based on GPR and Deep Reinforcement Learning
    Jin, Zhe-Hao
    Liu, An-Dong
    Yu, Li
    [J]. Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (09): : 2352 - 2360
  • [4] Robot multi-action cooperative grasping strategy based on deep reinforcement learning
    He, Huiteng
    Zhou, Yong
    Hu, Kaixiong
    Li, Weidong
    [J]. Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (05): : 1789 - 1797
  • [5] Maximum likelihood estimation framework for table-balancing adjustments
    Brent, Geoffrey
    [J]. STATISTICA NEERLANDICA, 2018, 72 (04) : 520 - 532
  • [6] Deep Reinforcement Learning for Motion Planning in Human Robot cooperative Scenarios
    Nicola, Giorgio
    Ghidoni, Stefano
    [J]. 2021 26TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2021,
  • [7] Cooperative Proactive Eavesdropping Based on Deep Reinforcement Learning
    Yang, Yaxin
    Li, Baogang
    Zhang, Shue
    Zhao, Wei
    Zhang, Haijun
    [J]. IEEE WIRELESS COMMUNICATIONS LETTERS, 2021, 10 (09) : 1857 - 1861
  • [8] Robot path planning based on deep reinforcement learning
    Long, Yinxin
    He, Huajin
    [J]. 2020 IEEE CONFERENCE ON TELECOMMUNICATIONS, OPTICS AND COMPUTER SCIENCE (TOCS), 2020, : 151 - 154
  • [9] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    [J]. 2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120
  • [10] Mobile Robot Navigation based on Deep Reinforcement Learning
    Ruan, Xiaogang
    Ren, Dingqi
    Zhu, Xiaoqing
    Huang, Jing
    [J]. PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 6174 - 6178