Resource provisioning for data-intensive applications with deadline constraints on hybrid clouds using Aneka

被引:50
|
作者
Toosi, Adel Nadjaran [1 ]
Sinnott, Richard O. [1 ]
Buyya, Rajkumar [1 ]
机构
[1] Univ Melbourne, Sch Comp & Informat Syst, Cloud Comp & Distributed Syst CLOUDS Lab, Melbourne, Vic, Australia
基金
澳大利亚研究理事会;
关键词
Dynamic provisioning; Hybrid cloud; Aneka cloud application platform; Deadline-driven scheduling; Data locality; Network bandwidth; Data-intensive applications;
D O I
10.1016/j.future.2017.05.042
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing has emerged as a mainstream paradigm for hosting various types of applications by supporting easy-to-use computing services. Among the many different forms of cloud computing, hybrid clouds, which mix on-premises private cloud and third-party public cloud services to deploy applications, have gained broad acceptance. They are particularly relevant for applications requiring large volumes of computing power exceeding the computational capacity within the premises of a single organization. However, the use of hybrid clouds introduces the challenge of how much and when public cloud resources should be added to the pool of resources - and especially when it is necessary to support quality of service requirements of applications with deadline constraints. These resource provisioning decisions are far from trivial if scheduling involves data-intensive applications using voluminous amounts of data. Issues such as the impact of network latency, bandwidth constraints, and location of data must be taken into account in order to minimize the execution cost while meeting the deadline for such applications. In this paper, we propose a new resource provisioning algorithm to support the deadline requirements of data-intensive applications in hybrid cloud environments. To evaluate our proposed algorithm, we implement it in Aneka, a platform for developing scalable applications on the Cloud. Experimental results using a real case study executing a data-intensive application to measure the walkability index on a hybrid cloud platform consisting of dynamic resources from the Microsoft Azure cloud show that our proposed provisioning algorithm is able to more efficiently allocate resources compared to existing methods. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:765 / 775
页数:11
相关论文
共 50 条
  • [1] Shared data-aware dynamic resource provisioning and task scheduling for data intensive applications on hybrid clouds using Aneka
    Tuli, Shreshth
    Sandhu, Rajinder
    Buyya, Rajkumar
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 106 : 595 - 606
  • [2] Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka
    Vecchiola, Christian
    Calheiros, Rodrigo N.
    Karunamoorthy, Dileban
    Buyya, Rajkumar
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2012, 28 (01): : 58 - 65
  • [3] Deadline based scheduling for data-intensive applications in clouds
    Fu Xiong
    Cang Yeliang
    Zhu Lipeng
    Hu Bin
    Deng Song
    Wang Dong
    [J]. The Journal of China Universities of Posts and Telecommunications., 2016, 23 (06) - 15
  • [4] Deadline based scheduling for data-intensive applications in clouds
    Fu Xiong
    Cang Yeliang
    Zhu Lipeng
    Hu Bin
    Deng Song
    Wang Dong
    [J]. The Journal of China Universities of Posts and Telecommunications, 2016, (06) : 8 - 15
  • [5] The Aneka platform and QoS-driven resource provisioning for elastic applications on hybrid Clouds
    Calheiros, Rodrigo N.
    Vecchiola, Christian
    Karunamoorthy, Dileban
    Buyya, Rajkumar
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2012, 28 (06): : 861 - 870
  • [6] Optimal Resource Provisioning for Data-intensive Microservices
    Erdei, Roland Mark
    Toka, Laszlo
    [J]. PROCEEDINGS OF THE IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM 2022, 2022,
  • [7] Distributed Energy-Efficient Scheduling for Data-Intensive Applications with Deadline Constraints on Data Grids
    Liu, Cong
    Qin, Xiao
    Kulkarni, Santosh
    Wang, Chengjun
    Li, Shuang
    Manzanares, Adam
    Baskiyar, Sanjeev
    [J]. 2008 IEEE INTERNATIONAL PERFORMANCE, COMPUTING AND COMMUNICATIONS CONFERENCE (IPCCC 2008), 2008, : 26 - 33
  • [8] Data-Intensive Workflow Scheduling in Cloud on Budget and Deadline Constraints
    Xin, Zhang
    Wu, Changze
    Wu, Kaigui
    [J]. COLLABORATE COMPUTING: NETWORKING, APPLICATIONS AND WORKSHARING, COLLABORATECOM 2016, 2017, 201 : 262 - 272
  • [9] A TOOLKIT FOR STORAGE QOS PROVISIONING FOR DATA-INTENSIVE APPLICATIONS
    Slota, Renata
    Krol, Dariusz
    Skalkowski, Kornel
    Orzechowski, Michal
    Nikolow, Darin
    Kryza, Bartosz
    Wrzeszcz, Michal
    Kitowski, Jacek
    [J]. COMPUTER SCIENCE-AGH, 2012, 13 (01): : 63 - 73
  • [10] Storage QoS provisioning for execution programming of data-intensive applications
    Slota, Renata
    [J]. SCIENTIFIC PROGRAMMING, 2012, 20 (01) : 69 - 80