Ceph: A scalable, high-performance distributed file system

被引：0
|
作者：
Weil, Sage A. [1 ]
Brandt, Scott A. [1 ]
Miller, Ethan L. [1 ]
Long, Darrell D. E. [1 ]
Maltzahn, Carlos [1 ]
机构：
[1] Univ Calif Santa Cruz, Santa Cruz, CA 95064 USA
来源：
USENIX ASSOCIATION 7TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION | 2006年
关键词：
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We have developed Ceph, a distributed file system that provides excellent performance, reliability, and scalability. Ceph maximizes the separation between data and metadata management by replacing allocation tables with a pseudo-random data distribution function (CRUSH) designed for heterogeneous and dynamic clusters of unreliable object storage devices (OSDs). We leverage device intelligence by distributing data replication, failure detection and recovery to semi-autonomous OSDs running a specialized local object file system. A dynamic distributed metadata cluster provides extremely efficient metadata management and seamlessly adapts to a wide range of general purpose and scientific computing file system workloads. Performance measurements under a variety of workloads show that Ceph has excellent I/O performance and scalable metadata management, supporting more than 250,000 metadata operations per second.
引用
收藏
页码：307 / +
页数：3
相关论文
共 50 条
  • [41] High-performance and highly reliable file system for the K computer
    Fujitsu Ltd., Japan
    [J]. Fujitsu Sci Tech J, 2012, 3 (302-309):
  • [42] High-Performance Distributed SCADA System Architecture
    Sagi, Mihaly
    Atlagic, Branislav
    Milinkov, Dejan
    Bogovac, Bojan
    Culaja, Stanko
    [J]. 2012 16TH IEEE MEDITERRANEAN ELECTROTECHNICAL CONFERENCE (MELECON), 2012, : 152 - 155
  • [43] zFS - A scalable distributed file system using object disks
    Rodeh, O
    Teperman, A
    [J]. 20TH IEEE/11TH NASA GODDARD CONFERENCE ON MASS STORAGE AND TECHNOLOGIES (MSST 2003), PROCEEDINGS, 2003, : 207 - 218
  • [44] HybridFS-A High Performance and Balanced File System Framework with Multiple Distributed File Systems
    Zhang, Lidong
    Wu, Yongwei
    Xue, Ruini
    Hsu, Tse-Chuan
    Yang, Hongji
    Chung, Yeh-Ching
    [J]. Proceedings - International Computer Software and Applications Conference, 2017, 1 : 796 - 805
  • [45] Network optimization for distributed memory file system on high performance computers
    Wu, Chun-Jia
    Liu, Guang-Ming
    Liu, Xin
    [J]. PROCEEDINGS OF THE 2ND ANNUAL INTERNATIONAL CONFERENCE ON ELECTRONICS, ELECTRICAL ENGINEERING AND INFORMATION SCIENCE (EEEIS 2016), 2016, 117 : 758 - 763
  • [46] THE DESIGN OF A HIGH-PERFORMANCE FILE SERVER
    VANRENESSE, R
    TANENBAUM, AS
    WILSCHUT, A
    [J]. 9TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS, 1989, : 22 - 27
  • [47] Cloud Distributed File Systems: a Benchmark of HDFS, Ceph, GlusterFS, and XtremeFS
    Acquaviva, Luca
    Bellavista, Paolo
    Corradi, Antonio
    Foschini, Luca
    Gioia, Leo
    Picone, Pasquale Carlo Maiorano
    [J]. 2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [48] Development of a High-Performance, Heterogenous, Scalable Test-Bed for Distributed Spacecraft
    Adams, Caleb
    Kempa, Brian
    Vaughan, Walter
    Cramer, Nicholas
    [J]. 2023 IEEE AEROSPACE CONFERENCE, 2023,
  • [49] DESIGN, MANUFACTURE AND EVALUATION OF A SCALABLE HIGH-PERFORMANCE NEURAL SYSTEM
    BOLOURI, H
    MORGAN, P
    GURNEY, K
    [J]. ELECTRONICS LETTERS, 1994, 30 (05) : 426 - 427
  • [50] RAMA: An easy-to-use, high-performance parallel file system
    Miller, EL
    Katz, RH
    [J]. PARALLEL COMPUTING, 1997, 23 (4-5) : 419 - 446
12345