Elastic Resource Provisioning Using Data Clustering in Cloud Service Platform

被引:13
|
作者
Fei, Bowen [1 ]
Zhu, Xiaomin [1 ]
Liu, Daqian [1 ]
Chen, Junjie [1 ]
Bao, Weidong [1 ]
Liu, Ling [2 ]
机构
[1] Natl Univ Def Technol, Coll Syst Engn, Changsha 410073, Hunan, Peoples R China
[2] Georgia Inst Technol, Coll Comp, 266 Ferst Dr, Atlanta, GA 30332 USA
基金
中国国家自然科学基金;
关键词
Cloud computing; elastic resource provisioning; clustering ensemble; decision-making; prediction model; SCIENTIFIC WORKFLOWS; SCHEDULING ALGORITHM;
D O I
10.1109/TSC.2020.3002755
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, cloud computing has received great attention in commerce and scientific research due to its flexibility and strong data processing capability. However, in view of the fact that the types of tasks display an upward trend as the growth of service demands, and the different types of tasks arrive at the system without regularity. Moreover, the resources deployed in cloud are insufficiency to be flexibly provisioned in the face of obvious workload fluctuations. In this article, we present a method of elastic resource provisioning using date clustering in cloud service platform. The framework of proposed method consists of three core components: tasks clustering, the amount of tasks prediction in cluster, dynamic resource provisioning and scheduling. In workload classification, we propose a clustering ensemble method, which utilizes a novel distance decision-making method to obtain the final results. Our method can effectively partition the arriving tasks into several clusters based on similarity among tasks. For each cluster, we forecast the amount of tasks arriving at next moment by prediction model based on time-series to provide reference for the follow-up resource provisioning. Afterwards, an energy-saving resource provisioning method is designed to dynamically provide resources for tasks in each cluster to meet their performance requirements. We implement the experiments in Google cloud traces dataset and the results show that our method achieves 92.3, 91.2 percent, and 3679.2 kW.h respectively in terms of guarantee ratio, resource utilization and total energy consumption, which demonstrates the effectiveness of proposed method for dynamic resource provisioning.
引用
收藏
页码:1578 / 1591
页数:14
相关论文
共 50 条
  • [1] Resource Provisioning Optimization for Service Hosting on Cloud Platform
    Shi, Jiyuan
    Dong, Fang
    Zhang, Jinghui
    Jin, Jiahui
    Luo, Junzhou
    [J]. 2016 IEEE 20TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2016, : 340 - 345
  • [2] Elastic Resource Provisioning System Based on OpenStack Cloud Platform
    Zhang, Zheng
    Xu, Hao
    Chen, Ke
    Shan, Pingping
    [J]. INDUSTRIAL IOT TECHNOLOGIES AND APPLICATIONS, INDUSTRIAL IOT 2017, 2017, 202 : 72 - 82
  • [3] Cloud service provisioning strategy using data center consortium clustering
    Liang, Bin
    Wu, Di
    Wu, Pengfei
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2023, 221
  • [4] A WebRTC based Live Streaming Service Platform with Dynamic Resource Provisioning in Cloud
    Kim, Woo-Joong
    Jang, Hyungyu
    Choi, Gyu-Beom
    Hwang, Il-Sun
    Youn, Chan-Hyun
    [J]. PROCEEDINGS OF THE 2016 IEEE REGION 10 CONFERENCE (TENCON), 2016, : 2424 - 2427
  • [5] A Resource Elastic Scheduling Algorithm of Service Platform for Cloud Robotics
    Ji Peng
    Chu Hao
    Chi Jianning
    Jiang Jingqi
    [J]. PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 4340 - 4344
  • [6] Elastic Resource Provisioning for Cloud Workflow Applications
    Li, Xiaoping
    Cai, Zhicheng
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2017, 14 (02) : 1195 - 1210
  • [7] Elastic Resource Provisioning for Cloud Based on Docker
    Qiu, Shi-da
    Zhu, Ming-fa
    Qin, Guang-jun
    Xiao, Li-min
    Song, Bin
    Wang, Shou-xin
    Liu, Rui
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER SCIENCE (AICS 2016), 2016, : 309 - 314
  • [8] Low Complexity Node Clustering in Cloud-RAN for Service Provisioning and Resource Allocation
    Wang, Haining
    Shetty, Priyesh
    Ding, Zhi
    [J]. GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [9] A Service Provisioning and Managing Framework for Platform as a Service in Educational Cloud
    Ameen, Mohd Noorul
    Sanjay, H. A.
    Patel, Yasser
    [J]. 2012 2ND IEEE INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (PDGC), 2012, : 262 - 267
  • [10] A Cloud Platform-as-a-Service for Multimedia Conferencing Service Provisioning
    Alam, Ahmad F. B.
    Soltanian, Abbas
    Yangui, Sami
    Salahuddin, Mohammad A.
    Glitho, Roch
    Elbiaze, Halima
    [J]. 2016 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATION (ISCC), 2016, : 289 - 294