Research on I/O resource scheduling algorithms for utility optimization towards cloud storage

被引:0
|
作者
Wang, Jianzong [1 ,2 ,3 ,4 ]
Chen, Yanjun [1 ,5 ]
Xie, Changsheng [1 ,2 ,3 ]
机构
[1] School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
[2] Wuhan National Laboratory for Optoelectronics, Wuhan 430074, China
[3] Key Laboratory of Data Storage System (Huazhong University of Science and Technology), Ministry of Education, Wuhan 430074, China
[4] NetEase Inc., Guangzhou 510665, China
[5] Georgia Institute of Technology, Atlanta, GA 30332, United States
来源
Jisuanji Yanjiu yu Fazhan/Computer Research and Development | 2013年 / 50卷 / 08期
关键词
Scheduling algorithms - Response time (computer systems) - Cloud storage;
D O I
暂无
中图分类号
学科分类号
摘要
Cloud-based services are emerging as an economical and convenient alternative for clients who don't want to acquire, maintain and operate their own IT equipment. Instead, customers purchase virtual machines (VMs) with certain service level objectives (SLOs) to obtain computational resources. Existing algorithms for memory and CPU allocation are inadequate for I/O allocation, especially in clustered storage infrastructures where storage is distributed across multiple storage nodes. This paper focuses on: 1) dynamic SLO decomposition so that VMs receive proper I/O service in each distributed storage node, and 2) efficient and robust local I/O scheduling strategy. To address these issues, we present an adaptive I/O resource scheduling algorithm (called PC) for utility optimization that at runtime adjusts local SLOs. The local SLOs are generated for each VM at each storage node based on access patterns. We also adopt dual clocks to allow automatic switching between two scheduling strategies. When system capacity is sufficient, we interweave requests in an earliest deadline first (EDF) manner. Otherwise resources are allocated proportionately to their normalized revenues. The results of our experiments suggest that the algorithm is adaptive to various access patterns without significant manual pre-settings while maximizing profits.
引用
收藏
页码:1657 / 1666
相关论文
共 50 条
  • [41] Research on Unified Resource Management and Scheduling System in Cloud Environment
    Hua Jiang
    Yanli Xiao
    Wireless Personal Communications, 2018, 102 : 963 - 973
  • [42] Performing scheduling and storage optimization simultaneously using genetic algorithms
    Torbey, E
    Knight, J
    1998 MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, PROCEEDINGS, 1999, : 284 - 287
  • [43] Dynamic Multi-Resource Optimization for Storage Acceleration in Cloud Storage Systems
    Lee, Kyungtae
    Kim, Jinhwi
    Kwak, Jeongho
    Kim, Yeongjin
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (02) : 1079 - 1092
  • [44] Online cost optimization algorithms for tiered cloud storage services
    Erradi, Abdelkarim
    Mansouri, Yaser
    JOURNAL OF SYSTEMS AND SOFTWARE, 2020, 160
  • [45] An Evolutionary Review on Resource Scheduling Algorithms Used for Cloud Computing with IoT Network
    Shakya, Santosh
    Tripathi, Priyanka
    RECENT ADVANCES IN ELECTRICAL & ELECTRONIC ENGINEERING, 2025, 18 (02) : 119 - 134
  • [46] Probabilistic Optimization of Resource Distribution and Encryption for Data Storage in the Cloud
    Luna, Jose Marcio
    Abdallah, Chaouki T.
    Heileman, Gregory L.
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (02) : 428 - 439
  • [47] qSDS: A QoS-Aware I/O Scheduling Framework towards Software Defined Storage
    Wang, Jianzong
    Cheng, Lianglun
    ELEVENTH 2015 ACM/IEEE SYMPOSIUM ON ARCHITECTURES FOR NETWORKING AND COMMUNICATIONS SYSTEMS, 2015, : 195 - 196
  • [48] Task scheduling algorithms for energy optimization in cloud environment: a comprehensive review
    R. Ghafari
    F. Hassani Kabutarkhani
    N. Mansouri
    Cluster Computing, 2022, 25 : 1035 - 1093
  • [49] Task scheduling algorithms for energy optimization in cloud environment: a comprehensive review
    Ghafari, R.
    Kabutarkhani, F. Hassani
    Mansouri, N.
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (02): : 1035 - 1093
  • [50] A Research on Video Files Scheduling Service Based on Cloud Storage
    Zhang, Yaqi
    Sui, Jianlong
    Liu, Zhen
    Chen, Dejun
    2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEM SCIENCE AND ENGINEERING (ICSSE), 2014, : 175 - 179