A sampling method based on distributed learning automata for solving stochastic shortest path problem

被引:4
|
作者
Beigy, Hamid [1 ]
Meybodi, Mohammad Reza [2 ]
机构
[1] Sharif Univ Technol, Dept Comp Engn, Sharif Intelligent Syst Lab, Tehran, Iran
[2] Amirkabir Univ Technol, Dept Comp Engn, Soft Comp Lab, Tehran, Iran
关键词
Distributed learning automata; Learning automata; Shortest path problem; Stochastic graph; TIME-VARYING TRANSPORTATION; LINK PREDICTION; NETWORKS; ALGORITHMS; GRAPHS;
D O I
10.1016/j.knosys.2020.106638
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies an iterative stochastic algorithm for solving the stochastic shortest path problem. This algorithm, which uses a distributed learning automata, tries to find the shortest path by taking a sufficient number of samples from the edges of the graph. In this algorithm, which edges to be sampled are determined dynamically as the algorithm proceeds. At each iteration of this algorithm, a distributed learning automata used to determine which edges to be sampled. This sampling method, which uses distributed learning automata, reduces the number of samplings from those edges, which may not be along the shortest path, and resulting in a reduction in the number of the edges to be sampled. In this paper, we propose a new method for analysis of the algorithm. The method proposed in this paper, unlike the previous ones, which were based on the Martingale theory, is based on the sampling. The proof given in this paper, unlike the previous ones, which were for a specific input graph, is not restricted to the input graph and is general. We also show that as the number of samples taken from the edges increases, the probability of finding the shortest path also increases. Experimental results obtained from some benchmark stochastic graphs and some random graphs also confirm the theoretical results. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Solving stochastic shortest path problem using Monte Carlo sampling method: A distributed learning automata approach
    Meybodi, MR
    Beigy, H
    [J]. NEURAL NETWORKS AND SOFT COMPUTING, 2003, : 626 - 631
  • [2] A new distributed learning automata based algorithm for solving stochastic shortest path problem
    Beigy, H
    Meybodi, MR
    [J]. PROCEEDINGS OF THE 6TH JOINT CONFERENCE ON INFORMATION SCIENCES, 2002, : 339 - 343
  • [3] An iterative stochastic algorithm based on distributed learning automata for finding the stochastic shortest path in stochastic graphs
    Beigy, Hamid
    Meybodi, Mohammad Reza
    [J]. JOURNAL OF SUPERCOMPUTING, 2020, 76 (07): : 5540 - 5562
  • [4] An iterative stochastic algorithm based on distributed learning automata for finding the stochastic shortest path in stochastic graphs
    Hamid Beigy
    Mohammad Reza Meybodi
    [J]. The Journal of Supercomputing, 2020, 76 : 5540 - 5562
  • [5] Utilizing distributed learning automata to solve stochastic shortest path problems
    Beigy, Hamid
    Meybodi, M. R.
    [J]. INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2006, 14 (05) : 591 - 615
  • [6] Stochastic learning automata-based dynamic algorithms for the Single Source Shortest Path Problem
    Misra, S
    Oommen, BJ
    [J]. INNOVATIONS IN APPLIED ARTIFICIAL INTELLIGENCE, 2004, 3029 : 239 - 248
  • [7] Posterior Sampling-Based Online Learning for the Stochastic Shortest Path Model
    Jafarnia-Jahromi, Mehdi
    Chen, Liyu
    Jain, Rahul
    Luo, Haipeng
    [J]. UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, 2023, 216 : 922 - 931
  • [8] Learning automata-based algorithms for solving the stochastic shortest path routing problems in 5G wireless communication
    Guo, Ying
    Li, Shenghong
    Jiang, Wen
    Zhang, Bo
    Ma, Yinghua
    [J]. PHYSICAL COMMUNICATION, 2017, 25 : 376 - 385
  • [9] Learning Generalized Policy Automata for Relational Stochastic Shortest Path Problems
    Karia, Rushang
    Nayyar, Rashmeet Kaur
    Srivastava, Siddharth
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [10] Dynamic algorithms for the shortest path routing problem: Learning automata-based solutions
    Misra, S
    Oommen, BJ
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (06): : 1179 - 1192