Reinforcement Learning based on State Space Model using Growing Neural Gas for a Mobile Robot

被引:2
|
作者
Arai, Tomoyuki [1 ]
Toda, Yuichiro [2 ]
Iwasa, Mutsumi [1 ]
Shao, Shuai [1 ]
Tonomura, Ryuta [1 ]
Kubota, Naoyuki [1 ]
机构
[1] Tokyo Metropolitan Univ, Grad Sch Syst Design, Tokyo, Japan
[2] Okayama Univ, Grad Sch Nat Sci Technol, Okayama, Japan
来源
2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS) | 2018年
关键词
Reinforcement Learning; Self-organization; Machine Learning; Mobile Robot; State Space;
D O I
10.1109/SCIS-ISIS.2018.00220
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the application of Reinforcement Learning to real tasks, a state space construction is an important problem. In order to use in real world environment, we need to deal with the problem of continuous information. Therefore, we proposed a Growing Neural Gas method based on state space construction model. In our system, the agent constructs State Space Model from its own experience autonomously. Furthermore, it can reconstruct a suitable state space to adapt complication of the environment. Through the experiments, we showed that our method using state space performs as well as the conventional method by using a smaller number of states.
引用
收藏
页码:1410 / 1413
页数:4
相关论文
共 50 条
  • [41] Behavior Decision of Mobile Robot With a Neurophysiologically Motivated Reinforcement Learning Model
    Wang, Dongshu
    Chen, Shuli
    Hu, Yuhang
    Liu, Lei
    Wang, Heshan
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (01) : 219 - 233
  • [42] A reinforcement learning using adaptive state space construction strategy for real autonomous mobile robots
    Kondo, T
    Ito, K
    SICE 2002: PROCEEDINGS OF THE 41ST SICE ANNUAL CONFERENCE, VOLS 1-5, 2002, : 3139 - 3144
  • [43] Robot Navigation Framework Based on Reinforcement Learning for Intelligent Space
    Jeni, Laszlo A.
    Istenes, Zoltan
    Szemes, Peter
    Hashimoto, Hideki
    2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 767 - +
  • [44] Growing Neural Gas Based Conversation Selection Model for Robot Partner and Human Communication System
    Yoshida, Shogo
    Kubota, Naoyuki
    2014 IEEE SYMPOSIUM ON ROBOTIC INTELLIGENCE IN INFORMATIONALLY STRUCTURED SPACE (RIISS), 2014, : 28 - 32
  • [45] Learning to Navigate for Mobile Robot with Continual Reinforcement Learning
    Wang, Ning
    Zhang, Dingyuan
    Wang, Yong
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 3701 - 3706
  • [46] Acceleration of Reinforcement Learning by a Mobile Robot Using Generalized Inhibition Rules
    Inoue, Kousuke
    Arai, Tamio
    Ota, Jun
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2010, 22 (01) : 122 - 133
  • [47] Model-Based Reinforcement Learning For Robot Control
    Li, Xiang
    Shang, Weiwei
    Cong, Shuang
    2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2020), 2020, : 300 - 305
  • [48] Behavior-based intelligent mobile robot using an immunized reinforcement adaptive learning mechanism
    Luh, GC
    Cheng, WC
    ADVANCED ENGINEERING INFORMATICS, 2002, 16 (02) : 85 - 98
  • [49] A SENSOR-BASED NAVIGATION FOR A MOBILE ROBOT USING FUZZY-LOGIC AND REINFORCEMENT LEARNING
    BEOM, HR
    CHO, HS
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1995, 25 (03): : 464 - 477
  • [50] Fast reinforcement learning using stochastic shortest paths for a mobile robot
    Kwon, Wooyoung
    Suh, Il Hong
    Lee, Sanghoon
    Cho, Young-Jo
    2007 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-9, 2007, : 82 - +