A New Approach to Double I/O performance for Ceph Distributed File System in Cloud Computing

被引:4
|
作者
Zhang, Xiao [1 ,2 ]
Wang, Yanqiu [1 ,2 ]
Wang, Qing [1 ,2 ]
Zhao, Xiaonan [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, 127 Youyi Xi Rd, Xian 710129, Shaanxi, Peoples R China
[2] MIIT NWPU, Key Lab Big Data Storage & Management, 127 Youyi Xi Rd, Xian 710129, Shaanxi, Peoples R China
关键词
D O I
10.1109/ICDIS.2019.00018
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Block storage resources are essential in an Infrastructure-as-a-Service(IaaS) cloud computing system. It is used for storing virtual machines' images. It offers persistent storage service even the virtual machine is off. Distribute storage systems are used to provide block storage services in IaaS, such as Amazon EBS, Cinder, Ceph, Sheepdog. Ceph is widely used as the backend block storage service of OpenStack platform. It converts block devices into objects with the same size and saves them on the local file system. The performance of block devices provided by Ceph is only 30% of hard disks in many cases. One of the key issues that affect the performance of Ceph is the three replicas for fault tolerance. But our research finds that replicas are not the real reason slow down the performance. In this paper, we present a new approach to accelerate the IO operations. The experiment results show that by using our storage engine, Ceph can offer faster IO performance than the hard disk in most cases. Our new storage engine provides more than three times up than the original one.
引用
收藏
页码:68 / 75
页数:8
相关论文
共 50 条
  • [1] Optimizing the Ceph Distributed File System for High Performance Computing
    Jeong, Kisik
    Duffy, Carl
    Kim, Jin-Soo
    Lee, Joonwon
    [J]. 2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP), 2019, : 446 - 451
  • [2] Ceph Distributed File System Benchmarks on an Openstack Cloud
    Zhang, X.
    Gaddam, S.
    Chronopoulos, A. T.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2016, : 113 - 120
  • [3] Ceph: A scalable, high-performance distributed file system
    Weil, Sage A.
    Brandt, Scott A.
    Miller, Ethan L.
    Long, Darrell D. E.
    Maltzahn, Carlos
    [J]. USENIX ASSOCIATION 7TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, 2006, : 307 - +
  • [4] Distributed parallel file system for I/O intensive parallel computing on clusters
    Domínguez-Domínguez, S
    Buenabad-Chávez, J
    [J]. 2004 1st International Conference on Electrical and Electronics Engineering (ICEEE), 2004, : 194 - 199
  • [5] Enabling Prioritized Cloud I/O Service in Hadoop Distributed File System
    Yeh, Tsozen
    Sun, Yifeng
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2014 IEEE 6TH INTL SYMP ON CYBERSPACE SAFETY AND SECURITY, 2014 IEEE 11TH INTL CONF ON EMBEDDED SOFTWARE AND SYST (HPCC,CSS,ICESS), 2014, : 256 - 259
  • [6] Cloud Distributed File Systems: a Benchmark of HDFS, Ceph, GlusterFS, and XtremeFS
    Acquaviva, Luca
    Bellavista, Paolo
    Corradi, Antonio
    Foschini, Luca
    Gioia, Leo
    Picone, Pasquale Carlo Maiorano
    [J]. 2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [7] THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING
    Ponnavaikko, Kovendhan
    Janakiram, D.
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2009, 10 (01): : 115 - 130
  • [8] The Enterprise Distributed File System Metadata Distribution in Cloud Computing Environment
    Suo, Hui
    Zhou, Gui-Xian
    Liu, Zhuo-hua
    [J]. 2016 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SECURITY (CSIS 2016), 2016, : 435 - 440
  • [9] Application Performance Analysis of Distributed File Systems under Cloud Computing Environment
    Zhao, Tiezhu
    Zhang, Zusheng
    Ao, Xin
    [J]. 2015 2ND INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING ICISCE 2015, 2015, : 152 - 155
  • [10] Performance analysis of parallel file system for I/O load balancing in distributed applications
    Deepalakshmi, S
    Baswaraj, K
    Rao, SSSP
    Jagdish, BS
    Sonavane, DD
    Dhekne, PS
    Kaura, HK
    [J]. PDPTA'03: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS 1-4, 2003, : 713 - 720