APPROXIMATE DYNAMIC PROGRAMMING TECHNIQUES FOR THE CONTROL OF TIME-VARYING QUEUING SYSTEMS APPLIED TO CALL CENTERS WITH ABANDONMENTS AND RETRIALS

被引:6
|
作者
Roubos, Dennis [1 ]
Bhulai, Sandjai [1 ]
机构
[1] Vrije Univ Amsterdam, Fac Sci, NL-1081 HV Amsterdam, Netherlands
关键词
D O I
10.1017/S026996480999012X
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
In this article we develop techniques for applying Approximate Dynamic Programming (ADP) to the control of time-varying queuing systems. First, we show that the classical state space representation in queuing systems leads to approximations that can be significantly improved by increasing the dimensionality of the state space by state disaggregation. Second, we deal with time-varying parameters by adding them to the state space with an ADP parameterization. We demonstrate these techniques for the optimal admission control in a retrial queue with abandonments and time-varying parameters. The numerical experiments show that our techniques have near to optimal performance.
引用
收藏
页码:27 / 45
页数:19
相关论文
共 50 条
  • [1] A Novel Approximate Dynamic Programming Structure for Optimal Control of Discrete-Time Time-Varying Nonlinear Systems
    Sun, Jiayue
    Xu, Zhiming
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (08) : 3835 - 3839
  • [2] APPROXIMATE DYNAMIC PROGRAMMING TECHNIQUES FOR SKILL-BASED ROUTING IN CALL CENTERS
    Roubos, D.
    Bhulai, S.
    [J]. PROBABILITY IN THE ENGINEERING AND INFORMATIONAL SCIENCES, 2012, 26 (04) : 581 - 591
  • [3] Time-varying fair queuing scheduling for multicode CDMA based on dynamic programming
    Stamoulis, A
    Sidiropoulos, N
    Giannakis, GB
    [J]. GLOBECOM '01: IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, VOLS 1-6, 2001, : 3504 - 3508
  • [4] Scaling and comparison of fluid limits of queues applied to call centers with time-varying parameters
    Tania Jiménez
    Ger Koole
    [J]. OR Spectrum, 2004, 26 : 413 - 422
  • [5] Scaling and comparison of fluid limits of queues applied to call centers with time-varying parameters
    Jiménez, T
    Koole, G
    [J]. OR SPECTRUM, 2004, 26 (03) : 413 - 422
  • [6] DYNAMIC MATRIX CONTROL FOR PROCESS SYSTEMS WITH TIME-VARYING PARAMETERS
    OGUNNAIKE, BA
    ADEWALE, KEP
    [J]. CHEMICAL ENGINEERING COMMUNICATIONS, 1986, 47 (4-6) : 295 - 314
  • [7] Adaptive Dynamic Programming and Optimal Stabilization for Linear Systems with Time-varying Uncertainty
    Zhang, Meng
    Gan, Ming-Gang
    Chen, Jie
    Jiang, Zhong-Ping
    [J]. 2017 11TH ASIAN CONTROL CONFERENCE (ASCC), 2017, : 1228 - 1233
  • [8] Adaptive dynamic programming for finite-horizon optimal control of linear time-varying discrete-time systems
    Bo Pang
    Tao Bian
    Zhong-Ping Jiang
    [J]. Control Theory and Technology, 2019, 17 : 73 - 84
  • [9] Adaptive dynamic programming for finite-horizon optimal control of linear time-varying discrete-time systems
    Pang, Bo
    Bian, Tao
    Jiang, Zhong-Ping
    [J]. CONTROL THEORY AND TECHNOLOGY, 2019, 17 (01) : 73 - 84
  • [10] Stabilizing Dynamic Control Design for Systems with Time-Varying Delay in Control Loop
    Ebrahimi, Behrouz
    Tafreshi, Reza
    Mohammadpour, Javad
    Franchek, Matthew
    Grigoriadis, Karolos
    [J]. 2014 AMERICAN CONTROL CONFERENCE (ACC), 2014, : 5558 - 5563