Exploring high performance distributed file storage using LDPC codes

被引：10
|
作者：
Gaidioz, Benjamin [1 ]
Koblitz, Birger
Santos, Nuno
机构：
[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland
来源：
PARALLEL COMPUTING | 2007年 / 33卷 / 4-5期
关键词：
distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;
D O I：
10.1016/j.parco.2007.02.003
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码：264 / 274
页数：11
相关论文
共 50 条
  • [21] Codes for Distributed Storage
    Ramkumar, Vinayak
    Balaji, S. B.
    Sasidharan, Birenjith
    Vajha, Myna
    Krishnan, M. Nikhil
    Kumar, P. Vijay
    FOUNDATIONS AND TRENDS IN COMMUNICATIONS AND INFORMATION THEORY, 2022, 19 (04): : 547 - 809
  • [22] Using LDPC codes to enhance the performance of FM-DCSK
    Wang, L
    Chen, GR
    2004 47TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL I, CONFERENCE PROCEEDINGS, 2004, : 401 - 404
  • [23] Performance Improvement of LDPC Codes using Soft Input Decryption
    Nandan., S.
    Deepthi., P. P.
    2012 INTERNATIONAL CONFERENCE ON GREEN TECHNOLOGIES (ICGT), 2012, : 11 - 14
  • [24] THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING
    Ponnavaikko, Kovendhan
    Janakiram, D.
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2009, 10 (01): : 115 - 130
  • [25] Review on LDPC Codes for Big Data Storage
    P. V. Bhuvaneshwari
    C. Tharini
    Wireless Personal Communications, 2021, 117 : 1601 - 1625
  • [26] Review on LDPC Codes for Big Data Storage
    Bhuvaneshwari, P. V.
    Tharini, C.
    WIRELESS PERSONAL COMMUNICATIONS, 2021, 117 (02) : 1601 - 1625
  • [27] Performance Optimization of In-Memory File System in Distributed Storage System
    Li, Zhaowei
    Yan, Yunlong
    Mo, Jintao
    Wen, Zhaocong
    Wu, Junmin
    2017 INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE, AND STORAGE (NAS), 2017, : 280 - 281
  • [28] Performance and Complexity Comparisons of Polar Codes and LDPC Codes
    Mensouri, Mohammed
    Aaroud, Abdessadek
    ADVANCED INTELLIGENT SYSTEMS FOR SUSTAINABLE DEVELOPMENT, AI2SD'2019, VOL 6: ADVANCED INTELLIGENT SYSTEMS FOR NETWORKS AND SYSTEMS, 2020, 92 : 207 - 216
  • [29] Distributed and High Performance Big-File Cloud Storage Based On Key-Value Store
    Thanh Trung Nguyen
    Minh Hieu Nguyen
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2016, 4 (03) : 159 - 172
  • [30] Using erasure codes efficiently for storage in a distributed system
    Aguilera, MK
    Janakiraman, R
    Xu, LH
    2005 INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS, PROCEEDINGS, 2005, : 336 - 345
12345