Server Frequency Control Using Markov Decision Processes

被引:4
|
作者
Chen, Lydia Y. [1 ]
Gautam, Natarajan [2 ]
机构
[1] IBM Zurich Res Lab, Zurich, Switzerland
[2] Texas A&M Univ, College Stn, TX 77843 USA
关键词
D O I
10.1109/INFCOM.2009.5062265
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
For a wide range of devices and servers, Dynamic Frequency Scaling (DFS) can reduce energy consumption to various degrees by appropriately trading-off system performance. Efficient DFS policies are able to adjust server frequencies by extrapolating the transition or the highly varying workload without incurring much of implementation overhead. This paper models DFS policies of a single server using Markov Decision Processes (MDP). To accommodate the highly varying nature of workload in the proposed MDP, we adopt fluid approximation based on continuous time Markov chain and discrete time Markov chain modeling for the fluid workload generator respectively. Accordingly, we design two frequency controllers (FC), namely C-FC and D-FC, corresponding to the continuous and discrete modeling of the workload generator. We evaluate the proposed policies on synthetic and web traces. The proposed C-FC and D-FC schemes ensure performance satisfaction with moderate energy saving as well as ease of implementation, in comparison with existing DFS policies.
引用
收藏
页码:2951 / +
页数:2
相关论文
共 50 条
  • [31] Using Markov decision processes for controlling an animal disease
    Utilisation des processus décisionnels de Markov pour l'aide à la maîtrise d'une maladie animale
    2013, Lavoisier (27) : 4 - 5
  • [32] Dynamic workflow composition using Markov decision processes
    Doshi, P
    Goodwin, R
    Akkiraju, R
    Verma, K
    IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, PROCEEDINGS, 2004, : 576 - 582
  • [33] Optimal Storage Scheduling Using Markov Decision Processes
    Grillo, Samuele
    Pievatolo, Antonio
    Tironi, Enrico
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (02) : 755 - 764
  • [34] On-line optimization of stochastic processes using Markov decision processes
    Saucedo, VM
    Karim, MN
    COMPUTERS & CHEMICAL ENGINEERING, 1996, 20 : S701 - S706
  • [35] MARKOV DECISION-PROCESSES WITH BOTH CONTINUOUS AND IMPULSIVE CONTROL
    YUSHKEVICH, AA
    LECTURE NOTES IN CONTROL AND INFORMATION SCIENCES, 1986, 81 : 234 - 246
  • [36] IMPULSIVE CONTROL FOR CONTINUOUS-TIME MARKOV DECISION PROCESSES
    Dufour, Francois
    Piunovskiy, Alexei B.
    ADVANCES IN APPLIED PROBABILITY, 2015, 47 (01) : 106 - 127
  • [37] On Exact Embedding Framework for Optimal Control of Markov Decision Processes
    Kharade, Sonam
    Sutavani, Sarang
    Yerudkar, Amol
    Wagh, Sushama
    Liu, Yang
    Del Vecchio, Carmen
    Singh, N. M.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (02) : 1316 - 1323
  • [38] A Bayesian Network Approach to Control of Networked Markov Decision Processes
    Adlakha, Sachin
    Lall, Sanjay
    Goldsmith, Andrea
    2008 46TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING, VOLS 1-3, 2008, : 446 - +
  • [39] Robust control of Markov decision processes with uncertain transition matrices
    Nilim, A
    El Ghaoui, L
    OPERATIONS RESEARCH, 2005, 53 (05) : 780 - 798
  • [40] Optimal control in Markov decision processes via distributed optimization
    Fu, Jie
    Han, Shuo
    Topcu, Ufuk
    2015 54TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2015, : 7462 - 7469