Server Frequency Control Using Markov Decision Processes

被引:4
|
作者
Chen, Lydia Y. [1 ]
Gautam, Natarajan [2 ]
机构
[1] IBM Zurich Res Lab, Zurich, Switzerland
[2] Texas A&M Univ, College Stn, TX 77843 USA
关键词
D O I
10.1109/INFCOM.2009.5062265
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
For a wide range of devices and servers, Dynamic Frequency Scaling (DFS) can reduce energy consumption to various degrees by appropriately trading-off system performance. Efficient DFS policies are able to adjust server frequencies by extrapolating the transition or the highly varying workload without incurring much of implementation overhead. This paper models DFS policies of a single server using Markov Decision Processes (MDP). To accommodate the highly varying nature of workload in the proposed MDP, we adopt fluid approximation based on continuous time Markov chain and discrete time Markov chain modeling for the fluid workload generator respectively. Accordingly, we design two frequency controllers (FC), namely C-FC and D-FC, corresponding to the continuous and discrete modeling of the workload generator. We evaluate the proposed policies on synthetic and web traces. The proposed C-FC and D-FC schemes ensure performance satisfaction with moderate energy saving as well as ease of implementation, in comparison with existing DFS policies.
引用
收藏
页码:2951 / +
页数:2
相关论文
共 50 条
  • [1] A Note on Infectious Disease Control using Markov Decision Processes
    Maeda Y.
    IEEJ Transactions on Electronics, Information and Systems, 2022, 142 (03) : 339 - 340
  • [2] Control Logic Synthesis for Manufacturing Systems Using Markov Decision Processes
    Lee, Changmin
    Park, Jehyun
    Choi, Jongeun
    Ha, Jaebok
    Lee, Sangyeong
    IFAC PAPERSONLINE, 2021, 54 (20): : 495 - 502
  • [3] The complexity of decentralized control of Markov decision processes
    Bernstein, DS
    Givan, R
    Immerman, N
    Zilberstein, S
    MATHEMATICS OF OPERATIONS RESEARCH, 2002, 27 (04) : 819 - 840
  • [4] Application of markov decision processes to the frequency assignment problem
    Greff, JY
    Idoumghar, L
    Schott, R
    APPLIED ARTIFICIAL INTELLIGENCE, 2004, 18 (08) : 761 - 773
  • [5] Deriving Explicit Control Policies for Markov Decision Processes Using Symbolic Regression
    Hristov, A.
    Bosman, J. W.
    Bhulai, S.
    van der Mei, R. D.
    PROCEEDINGS OF THE 13TH EAI INTERNATIONAL CONFERENCE ON PERFORMANCE EVALUATION METHODOLOGIES AND TOOLS ( VALUETOOLS 2020), 2020, : 41 - 47
  • [6] Monotone optimal control for a class of Markov decision processes
    Zhuang, Weifen
    Li, Michael Z. F.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2012, 217 (02) : 342 - 350
  • [7] Optimal control in light traffic Markov Decision Processes
    INRIA, Sophia Antipolis, France
    ZOR, 1 (63-79):
  • [8] Optimal control in light traffic Markov decision processes
    Ger Koole
    Olaf Passchier
    Mathematical Methods of Operations Research, 1997, 45 : 63 - 79
  • [9] Decentralized Control of Partially Observable Markov Decision Processes
    Amato, Christopher
    Chowdhary, Girish
    Geramifard, Alborz
    Uere, N. Kemal
    Kochenderfer, Mykel J.
    2013 IEEE 52ND ANNUAL CONFERENCE ON DECISION AND CONTROL (CDC), 2013, : 2398 - 2405
  • [10] Control of Markov Decision Processes from PCTL specifications
    Lahijanian, M.
    Andersson, S. B.
    Belta, C.
    2011 AMERICAN CONTROL CONFERENCE, 2011, : 311 - 316