QoSC: A QoS-Aware Storage Cloud Based on HDFS

被引：2
|
作者：
Yang, Bowei [1 ]
Song, Guanghua [1 ]
Zheng, Yao [1 ]
Wu, Yue [2 ]
机构：
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou, Zhejiang, Peoples R China
[2] Univ Sheffield, Dept Elect & Elect Engn, Sheffield, S Yorkshire, England
来源：
2015 INTERNATIONAL SYMPOSIUM ON SECURITY AND PRIVACY IN SOCIAL NETWORKS AND BIG DATA (SOCIALSEC 2015) | 2015年
关键词：
QoS; Hadoop; Distributed Storage; Reputation; MAPREDUCE;
D O I：
10.1109/SocialSec2015.14
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Storage QoS is a key issue for a storage cloud infrastructure. This paper presents QoSC, a QoS-aware storage cloud for storing massive data over the dynamic network, based on the Hadoop distributed file system (HDFS). QoSC employs a data redundancy policy based on recovery volumes and a QoS-aware data placement strategy. We consider the QoS of a storage node as a combination of the transfer bandwidth, the availability of service, the workload (CPU utilization), and the free storage space. We have deployed QoSC on the campus network of Zhejiang University, and have conducted a group of experiments on file storage and retrieval. The experimental results show that QoSC improves the performance of file storage and retrieval and balances the workload among DataNodes, by being aware of QoS of DataNodes.
引用
收藏
页码：32 / 38
页数：7
相关论文
共 50 条
  • [1] QoS-aware indiscriminate volume storage cloud
    Yang, Bowei
    Song, Guanghua
    Chen, Yining
    Zheng, Yao
    Wu, Yue
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (07):
  • [2] An Adaptive Qos-Aware Cloud
    Zhang Yuchao
    Deng Bo
    Peng Fuyang
    [J]. 2012 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGIES, APPLICATIONS AND MANAGEMENT (ICCCTAM), 2012, : 160 - 163
  • [3] Cloud service selection based on QoS-aware logistics
    Wenxue Ran
    Huijuan Liu
    [J]. Soft Computing, 2020, 24 : 4323 - 4332
  • [4] Cloud service selection based on QoS-aware logistics
    Ran, Wenxue
    Liu, Huijuan
    [J]. SOFT COMPUTING, 2020, 24 (06) : 4323 - 4332
  • [5] QoS-Aware Distributed Cloud Storage Service based on Erasure Code in Multi-Cloud Environment
    Su, Wei-Tsung
    Dai, Cheng-Yi
    [J]. 2017 14TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2017, : 365 - 368
  • [6] QoS-Aware Cloud Application Management
    Martin, Patrick
    Soltani, Sima
    Powley, Wendy
    Hassannezhad, Mastoureh
    [J]. CLOUD COMPUTING AND BIG DATA, 2013, 23 : 20 - 34
  • [7] QoS-aware Service Redeployment in Cloud
    You, Kun
    Qian, Zhuzhong
    Guo, Song
    Lu, Sanglu
    Chen, Daoxu
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2011,
  • [8] QoS-aware genetic Cloud Brokering
    Anastasi, Gaetano F.
    Carlini, Emanuele
    Coppola, Massimo
    Dazzi, Patrizio
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 75 : 1 - 13
  • [9] Cloud service selection model based on QoS-aware in cloud manufacturing environment
    [J]. Ma, W.-L. (qzmwlmwl@126.com), 1600, CIMS (20):
  • [10] The Journey of QoS-Aware Autonomic Cloud Computing
    Singh, Sukhpal
    Chana, Inderveer
    Singh, Maninder
    [J]. IT PROFESSIONAL, 2017, 19 (02) : 42 - 49
12345