Applying a Neural Network Architecture with Spatio-Temporal Connections to the Maze Exploration

被引:0
|
作者
Filin, Dmitry [1 ]
Panov, Aleksandr I. [1 ,2 ]
机构
[1] Natl Res Univ, Higher Sch Econ, Moscow, Russia
[2] Russian Acad Sci, Fed Res Ctr Comp Sci & Control, Moscow, Russia
关键词
D O I
10.1007/978-3-319-63940-6_8
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
We present a model of Reinforcement Learning, which consists of modified neural-network architecture with spatio-temporal connections, known as Temporal Hebbian Self-Organizing Map (THSOM). A number of experiments were conducted to test the model on the maze solving problem. The algorithm demonstrates sustainable learning, building a near to optimal routes. This work describes an agents behavior in the mazes of different complexity and also influence of models parameters at the length of formed paths.
引用
收藏
页码:57 / 64
页数:8
相关论文
共 50 条
  • [21] Integrated Spatio-Temporal Graph Neural Network for Traffic Forecasting
    Singh, Vandana
    Sahana, Sudip Kumar
    Bhattacharjee, Vandana
    APPLIED SCIENCES-BASEL, 2024, 14 (24):
  • [22] Heterogeneous recurrent spiking neural network for spatio-temporal classification
    Chakraborty, Biswadeep
    Mukhopadhyay, Saibal
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [23] Application of a Dynamic Recurrent Neural Network in Spatio-Temporal Forecasting
    Cheng, Tao
    Wang, Jiaqiu
    INFORMATION FUSION AND GEOGRAPHIC INFORMATION SYSTEMS, PROCEEDINGS, 2007, : 173 - +
  • [24] A Spatio-Temporal Convolutional Neural Network for Skeletal Action Recognition
    Hu, Lizhang
    Xu, Jinhua
    NEURAL INFORMATION PROCESSING (ICONIP 2017), PT III, 2017, 10636 : 377 - 385
  • [25] EEG Source Localization Using Spatio-Temporal Neural Network
    Song Cui
    Lijuan Duan
    Bei Gong
    Yuanhua Qiao
    Fan Xu
    Juncheng Chen
    Changming Wang
    中国通信, 2019, 16 (07) : 131 - 143
  • [26] Spatio-Temporal Wireless Traffic Prediction With Recurrent Neural Network
    Qiu, Chen
    Zhang, Yanyan
    Feng, Zhiyong
    Zhang, Ping
    Cui, Shuguang
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2018, 7 (04) : 554 - 557
  • [27] An adaptive wavelet neural network for spatio-temporal system identification
    Wei, H. L.
    Billings, S. A.
    Zhao, Y. F.
    Guo, L. Z.
    NEURAL NETWORKS, 2010, 23 (10) : 1286 - 1299
  • [28] STANN: A Spatio-Temporal Attentive Neural Network for Traffic Prediction
    He, Zhixiang
    Chow, Chi-Yin
    Zhang, Jia-Dong
    IEEE ACCESS, 2019, 7 : 4795 - 4806
  • [29] Spatio-Temporal Hypergraph Neural ODE Network for Traffic Forecasting
    Yao, Chengzhi
    Li, Zhi
    Wang, Jumbo
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1499 - 1504
  • [30] A spatio-temporal neural network applied to visual speech recognition
    Baig, AR
    Séguier, R
    Vaucher, G
    NINTH INTERNATIONAL CONFERENCE ON ARTIFICIAL NEURAL NETWORKS (ICANN99), VOLS 1 AND 2, 1999, (470): : 797 - 802