Ceph: A scalable, high-performance distributed file system

被引：0
|
作者：
Weil, Sage A. [1 ]
Brandt, Scott A. [1 ]
Miller, Ethan L. [1 ]
Long, Darrell D. E. [1 ]
Maltzahn, Carlos [1 ]
机构：
[1] Univ Calif Santa Cruz, Santa Cruz, CA 95064 USA
来源：
USENIX ASSOCIATION 7TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION | 2006年
关键词：
D O I：
暂无
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We have developed Ceph, a distributed file system that provides excellent performance, reliability, and scalability. Ceph maximizes the separation between data and metadata management by replacing allocation tables with a pseudo-random data distribution function (CRUSH) designed for heterogeneous and dynamic clusters of unreliable object storage devices (OSDs). We leverage device intelligence by distributing data replication, failure detection and recovery to semi-autonomous OSDs running a specialized local object file system. A dynamic distributed metadata cluster provides extremely efficient metadata management and seamlessly adapts to a wide range of general purpose and scientific computing file system workloads. Performance measurements under a variety of workloads show that Ceph has excellent I/O performance and scalable metadata management, supporting more than 250,000 metadata operations per second.
引用
收藏
页码：307 / +
页数：3
相关论文
共 50 条
  • [1] Optimizing the Ceph Distributed File System for High Performance Computing
    Jeong, Kisik
    Duffy, Carl
    Kim, Jin-Soo
    Lee, Joonwon
    [J]. 2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP), 2019, : 446 - 451
  • [2] Cryptographic security for a high-performance distributed file system
    Pletka, Roman
    Cachin, Christian
    [J]. 24TH IEEE CONFERENCE ON MASS STORAGE SYSTEMS AND TECHNOLOGIES, PROCEEDINGS, 2007, : 227 - +
  • [3] Evaluating ParFiSys: A high-performance parallel and distributed file system
    Perez, F
    Carretero, J
    Garcia, F
    DeMiguel, P
    Alonso, L
    [J]. JOURNAL OF SYSTEMS ARCHITECTURE, 1997, 43 (08) : 533 - 542
  • [4] Ceph Distributed File System Benchmarks on an Openstack Cloud
    Zhang, X.
    Gaddam, S.
    Chronopoulos, A. T.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING IN EMERGING MARKETS (CCEM), 2016, : 113 - 120
  • [5] Dynamic core affinity for high-performance file upload on Hadoop Distributed File System
    Cho, Joong-Yeon
    Jin, Hyun-Wook
    Lee, Min
    Schwan, Karsten
    [J]. PARALLEL COMPUTING, 2014, 40 (10) : 722 - 737
  • [6] IncFS: An integrated high-performance distributed file system based on NFS
    Zhao, Yi
    Tang, Rongfeng
    Xiong, Jin
    Ma, Jie
    [J]. NAS: 2006 INTERNATIONAL WORKSHOP ON NETWORKING, ARCHITECTURE, AND STORAGES, PROCEEDINGS, 2006, : 87 - +
  • [7] A High-Performance and Scalable Distributed Storage and Computing System for IMS Services
    Seraoui, Youssef
    Bellafkih, Mostafa
    Raouyane, Brahim
    [J]. 2016 2ND INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGIES AND APPLICATIONS (CLOUDTECH), 2016, : 335 - 342
  • [8] A High-Performance Distributed Relational Database System for Scalable OLAP Processing
    Arnold, Jason
    Glavic, Boris
    Raicu, Ioan
    [J]. 2019 IEEE 33RD INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2019), 2019, : 738 - 748
  • [9] A HIGH-PERFORMANCE FILE SYSTEM FOR UNIX
    POSTON, A
    [J]. PROCEEDINGS : WORKSHOP ON UNIX AND SUPERCOMPUTERS, 1988, : 215 - 226
  • [10] Key Technology of Distributed Memory File System Based on High-Performance Computer
    Liu, Mingxing
    [J]. INTERNATIONAL JOURNAL OF COOPERATIVE INFORMATION SYSTEMS, 2023,
12345