A method of approximation of non-Markov controllable queueing processes

被引:0
|
作者
Burlakov, MV
机构
关键词
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A Markov approximation method for non-Markov controllable queueing processes (NCQP) is put forward, the essence of which is that it involves developing a certain equivalent Markov controllable process with a finite number of states and controls, synthesizing numerically an optimal strategy of situation control of this process, and using this strategy for control of the desired NCQP. A class of NCQPs with limited aftereffects is described, the study of which can be made by the suggested approximation method. General properties of the Markov approximation are clarified and an example of this type of approximation is given for the investigation of a non-Markov controllable queueing system. Results of the experiment are offered, including results of the comparative analysis of the suggested Markov approximation method for NCQPs and the known method of timing.
引用
收藏
页码:983 / 994
页数:12
相关论文
共 50 条
  • [21] Engset formulas for nonhomogeneous non-Markov queueing systems and their application in communication networks
    Nazarov, A.A.
    [J]. Problemy Peredachi Informatsii, 1998, 54 (55): : 109 - 116
  • [22] Non-Markov stochastic processes satisfying equations usually associated with a Markov process
    McCauley, J. L.
    [J]. EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2012, 204 (01): : 133 - 143
  • [23] Non-Markov stochastic processes satisfying equations usually associated with a Markov process
    J. L. McCauley
    [J]. The European Physical Journal Special Topics, 2012, 204 : 133 - 143
  • [24] On Q-learning Convergence for Non-Markov Decision Processes
    Majeed, Sultan Javed
    Hutter, Marcus
    [J]. PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 2546 - 2552
  • [25] Modeling Stem Cell Fates using Non-Markov Processes
    Stumpf, Patrick S.
    Arai, Fumio
    MacArthur, Ben D.
    [J]. CELL STEM CELL, 2021, 28 (02) : 187 - 190
  • [26] TIME EVOLUTION, CORRELATIONS, AND LINEAR RESPONSE OF NON-MARKOV PROCESSES
    HANGGI, P
    THOMAS, H
    [J]. ZEITSCHRIFT FUR PHYSIK B-CONDENSED MATTER, 1977, 26 (01): : 85 - 92
  • [27] The Non-Markov Adaptive Retrial Queueing System with the Incoming MMPP-Flow of Requests
    Lyubina, Tatyana
    Garayshina, Irina
    [J]. INFORMATION TECHNOLOGIES AND MATHEMATICAL MODELLING, 2014, 487 : 261 - 268
  • [28] TIME-REVERSAL OF NON-MARKOV POINT-PROCESSES
    ELLIOTT, RJ
    TSOI, AH
    [J]. ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 1990, 26 (02): : 357 - 373
  • [29] CORRELATION AND LINEAR RESPONSE FOR STOCHASTIC-PROCESSES WITH MEMORY (NON-MARKOV PROCESSES)
    HANGGI, P
    THOMAS, H
    [J]. HELVETICA PHYSICA ACTA, 1977, 50 (02): : 230 - 230
  • [30] Episodic non-Markov localization
    Biswas, Joydeep
    Veloso, Manuela M.
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 87 : 162 - 176