Reinforcement Learning based on State Space Model using Growing Neural Gas for a Mobile Robot

被引:2
|
作者
Arai, Tomoyuki [1 ]
Toda, Yuichiro [2 ]
Iwasa, Mutsumi [1 ]
Shao, Shuai [1 ]
Tonomura, Ryuta [1 ]
Kubota, Naoyuki [1 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Okayama Univ, Grad Sch Nat Sci Technol, Okayama, Japan
关键词
Reinforcement Learning; Self-organization; Machine Learning; Mobile Robot; State Space;
D O I
10.1109/SCIS-ISIS.2018.00220
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the application of Reinforcement Learning to real tasks, a state space construction is an important problem. In order to use in real world environment, we need to deal with the problem of continuous information. Therefore, we proposed a Growing Neural Gas method based on state space construction model. In our system, the agent constructs State Space Model from its own experience autonomously. Furthermore, it can reconstruct a suitable state space to adapt complication of the environment. Through the experiments, we showed that our method using state space performs as well as the conventional method by using a smaller number of states.
引用
收藏
页码:1410 / 1413
页数:4
相关论文
共 50 条
  • [1] Environmental Map Learning Method based on Growing Neural Gas for a Mobile Robot
    Li, Qi
    Toda, Yuichiro
    Nagao, Keisuke
    Matsuno, Takayuki
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [2] BEHAVIOR ACQUISITION ON A MOBILE ROBOT USING REINFORCEMENT LEARNING WITH CONTINUOUS STATE SPACE
    Arai, Tomoyuki
    Toda, Yuichiro
    Kubota, Naoyuki
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), 2019, : 458 - 461
  • [3] A reinforcement learning with adaptive state space construction for mobile robot navigation
    Li, Guizhi
    Pang, Jie
    PROCEEDINGS OF THE 2006 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL, 2006, : 84 - 88
  • [4] Metric State Space Reinforcement Learning for a Vision-Capable Mobile Robot
    Zhumatiy, Viktor
    Gomez, Faustino
    Hutter, Marcus
    Schmidhuber, Juergen
    INTELLIGENT AUTONOMOUS SYSTEMS 9, 2006, : 272 - +
  • [5] Passability-Based Local Planner Using Growing Neural Gas for an Autonomous Mobile Robot
    Ozasa, Koki
    Toda, Yuichiro
    Nakamura, Yoshimasa
    Masuda, Toshiki
    Konishi, Hirohide
    Matsuno, Takayuki
    IEEE ACCESS, 2024, 12 : 171824 - 171835
  • [6] Mobile Robot Navigation Using Reinforcement Learning Based on Neural Network with Short Term Memory
    Gavrilov, Andrey V.
    Lenskiy, Artem
    ADVANCED INTELLIGENT COMPUTING, 2011, 6838 : 210 - +
  • [7] Reinforcement learning for a vision based mobile robot
    Gaskett, C
    Fletcher, L
    Zelinsky, A
    2000 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2000), VOLS 1-3, PROCEEDINGS, 2000, : 403 - 409
  • [8] Growing Robot Navigation Based on Deep Reinforcement Learning
    Ataka, Ahmad
    Sandiwan, Andreas P.
    2023 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS, ICCAR, 2023, : 115 - 120
  • [9] Position control of a mobile robot using reinforcement learning
    Farias, G.
    Garcia, G.
    Montenegro, G.
    Fabregas, E.
    Dormido-Canto, S.
    Dormido, S.
    IFAC PAPERSONLINE, 2020, 53 (02): : 17393 - 17398
  • [10] Mobile Robot Navigation Using Deep Reinforcement Learning
    Lee, Min-Fan Ricky
    Yusuf, Sharfiden Hassen
    PROCESSES, 2022, 10 (12)