Reinforcement Learning based on State Space Model using Growing Neural Gas for a Mobile Robot

被引:2
|
作者
Arai, Tomoyuki [1 ]
Toda, Yuichiro [2 ]
Iwasa, Mutsumi [1 ]
Shao, Shuai [1 ]
Tonomura, Ryuta [1 ]
Kubota, Naoyuki [1 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Okayama Univ, Grad Sch Nat Sci Technol, Okayama, Japan
来源
2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS) | 2018年
关键词
Reinforcement Learning; Self-organization; Machine Learning; Mobile Robot; State Space;
D O I
10.1109/SCIS-ISIS.2018.00220
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the application of Reinforcement Learning to real tasks, a state space construction is an important problem. In order to use in real world environment, we need to deal with the problem of continuous information. Therefore, we proposed a Growing Neural Gas method based on state space construction model. In our system, the agent constructs State Space Model from its own experience autonomously. Furthermore, it can reconstruct a suitable state space to adapt complication of the environment. Through the experiments, we showed that our method using state space performs as well as the conventional method by using a smaller number of states.
引用
收藏
页码:1410 / 1413
页数:4
相关论文
共 50 条
  • [21] A Model-free Mapless Navigation Method for Mobile Robot Using Reinforcement Learning
    Lv Qiang
    Duo Nanxun
    Lin Huican
    Wei Heng
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 3410 - 3415
  • [22] Adaptive Function Approximation in Reinforcement Learning with an Interpolating Growing Neural Gas
    Baumann, Michael
    Buening, Hans Kleine
    2012 12TH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS (HIS), 2012, : 512 - 517
  • [23] State Recognition and Reinforcement Learning for Two-Wheel Mobile Robot
    Yasutake, Yoshihiro
    2018 18TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS AND INFORMATION TECHNOLOGIES (ISCIT), 2018, : 452 - 457
  • [24] Using the GTSOM Network for Mobile Robot Navigation with Reinforcement Learning
    Menegaz, Mauricio
    Engel, Paulo M.
    IJCNN: 2009 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1- 6, 2009, : 716 - 720
  • [25] Skills' learning in an autonomous mobile robot using continuous reinforcement
    Boada, MJL
    Salichs, MA
    ADVANCED FUZZY-NEURAL CONTROL 2001, 2002, : 117 - 122
  • [26] Behavior Pattern Learning for Robot Partner based on Growing Neural Networks in Informationally Structured Space
    Obo, Takenori
    Kubota, Naoyuki
    2014 IEEE SYMPOSIUM ON ROBOTIC INTELLIGENCE IN INFORMATIONALLY STRUCTURED SPACE (RIISS), 2014, : 86 - 91
  • [27] Behavior coordination for a mobile robot using modular reinforcement learning
    Uchibe, E
    Asada, M
    Hosoda, K
    IROS 96 - PROCEEDINGS OF THE 1996 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS - ROBOTIC INTELLIGENCE INTERACTING WITH DYNAMIC WORLDS, VOLS 1-3, 1996, : 1329 - 1336
  • [28] Acceleration of reinforcement learning by a mobile robot using generalized rules
    Inoue, K
    Ota, J
    Katayama, T
    Arai, T
    2000 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2000), VOLS 1-3, PROCEEDINGS, 2000, : 885 - 890
  • [29] Reinforcement learning on a omnidirectional mobile robot
    Hafner, R
    Riedmiller, M
    IROS 2003: PROCEEDINGS OF THE 2003 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-4, 2003, : 418 - 423
  • [30] Deep Reinforcement Learning Based Mobile Robot Navigation: A Review
    Zhu, Kai
    Zhang, Tao
    TSINGHUA SCIENCE AND TECHNOLOGY, 2021, 26 (05) : 674 - 691