A New Approach to Double I/O performance for Ceph Distributed File System in Cloud Computing

被引:4
|
作者
Zhang, Xiao [1 ,2 ]
Wang, Yanqiu [1 ,2 ]
Wang, Qing [1 ,2 ]
Zhao, Xiaonan [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, 127 Youyi Xi Rd, Xian 710129, Shaanxi, Peoples R China
[2] MIIT NWPU, Key Lab Big Data Storage & Management, 127 Youyi Xi Rd, Xian 710129, Shaanxi, Peoples R China
关键词
D O I
10.1109/ICDIS.2019.00018
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Block storage resources are essential in an Infrastructure-as-a-Service(IaaS) cloud computing system. It is used for storing virtual machines' images. It offers persistent storage service even the virtual machine is off. Distribute storage systems are used to provide block storage services in IaaS, such as Amazon EBS, Cinder, Ceph, Sheepdog. Ceph is widely used as the backend block storage service of OpenStack platform. It converts block devices into objects with the same size and saves them on the local file system. The performance of block devices provided by Ceph is only 30% of hard disks in many cases. One of the key issues that affect the performance of Ceph is the three replicas for fault tolerance. But our research finds that replicas are not the real reason slow down the performance. In this paper, we present a new approach to accelerate the IO operations. The experiment results show that by using our storage engine, Ceph can offer faster IO performance than the hard disk in most cases. Our new storage engine provides more than three times up than the original one.
引用
收藏
页码:68 / 75
页数:8
相关论文
共 50 条
  • [31] MLFS: A Multiple Layers Share File System for Cloud Computing
    Zhang, Xiao
    Guo, Wan
    Li, Zhanhuai
    Zhao, Xiaonan
    Qin, Xiao
    [J]. 2014 GLOBECOM WORKSHOPS (GC WKSHPS), 2014, : 99 - 105
  • [32] Performance Optimization of Small File I/O with Adaptive Migration Strategy in Cluster File System
    Li, Xiuqiao
    Dong, Bin
    Xiao, Limin
    Ruan, Li
    [J]. HIGH PERFORMANCE COMPUTING AND APPLICATIONS, 2010, 5938 : 242 - 249
  • [33] Combining Buffered I/O and Direct I/O in Distributed File Systems
    Qian, Yingjin
    Vef, Marc-Andre
    Farrell, Patrick
    Dilger, Andreas
    Li, Xi
    Ihara, Shuichi
    Fu, Yinjin
    Xue, Wei
    Brinkmann, Andre
    [J]. PROCEEDINGS OF THE 22ND USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, FAST 24, 2024, : 17 - 33
  • [34] A relevance and redundancy aware performance feature selection approach for distributed file system
    Engineering and Technology Institute, Dongguan University of Technology, Dongguan 523808, China
    [J]. J. Comput. Inf. Syst., 2013, 10 (4011-4018):
  • [35] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Chen, ZG
    Zeng, BQ
    Xiong, C
    Deng, XH
    Zeng, ZW
    Liu, AF
    [J]. JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2005, 12 (05): : 572 - 577
  • [36] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    陈志刚
    曾碧卿
    熊策
    邓晓衡
    曾志文
    刘安丰
    [J]. Journal of Central South University, 2005, (05) : 572 - 577
  • [37] Heuristic file sorted assignment algorithm of parallel I/O on cluster computing system
    Zhi-gang Chen
    Bi-qing Zeng
    Ce Xiong
    Xiao-heng Deng
    Zhi-wen Zeng
    An-feng Liu
    [J]. Journal of Central South University of Technology, 2005, 12 : 572 - 577
  • [38] Design and Implementation of a Distributed Versioning File System for Cloud Rendering
    Cho, Kyungwoon
    Bahn, Hyokyung
    [J]. IEEE ACCESS, 2021, 9 : 138716 - 138723
  • [39] Distributed file system support for virtual machines in grid computing
    Zhao, M
    Zhang, H
    Figueiredo, R
    [J]. 13TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, PROCEEDINGS, 2004, : 202 - 211
  • [40] Fastdfs: A high performance distributed file system
    [J]. Liu, Xiaoyan, 1741, ICIC Express Letters Office (05):