Exploring high performance distributed file storage using LDPC codes

被引：10
|
作者：
Gaidioz, Benjamin [1 ]
Koblitz, Birger
Santos, Nuno
机构：
[1] Ecole Polytech Fed Lausanne, CH-1015 Lausanne, Switzerland
[2] CERN, European Org Nucl Res, CH-1211 Geneva, Switzerland
来源：
PARALLEL COMPUTING | 2007年 / 33卷 / 4-5期
关键词：
distributed file storage; low-density parity-check (LDPC) codes; high-availability; high-performance;
D O I：
10.1016/j.parco.2007.02.003
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We explore the feasibility of implementing a reliable, high performance, distributed storage system on a commodity computing cluster. Files are distributed across storage nodes using erasure coding with small low-density parity-check (LDPC) codes, which provide high-reliability with small storage and performance overhead. We present performance measurements done on a prototype system comprising 50 nodes, which are self organised using a peer-to-peer overlay. (C) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码：264 / 274
页数：11
相关论文
共 50 条
  • [41] A Construction of High Performance Quasicyclic LDPC Codes: A Combinatoric Design Approach
    Asif, Muhammad
    Zhou, Wuyang
    Ajmal, Muhammad
    Akhtar, Zain ul Abiden
    Khan, Nauman Ali
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2019, 2019
  • [42] On the Exploitation of Blockchain for Distributed File Storage
    Ning, Zuoting
    Xiao, Lijun
    Liang, Wei
    Shi, Weiqi
    Li, Kuan-Ching
    JOURNAL OF SENSORS, 2020, 2020
  • [43] A Distributed CRC Early Termination Scheme for High Throughput QC-LDPC Codes
    Wu, Hao
    Wang, Fang
    Yuan, Yuqing
    2018 10TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2018,
  • [44] HybridFS - A High Performance and Balanced File System Framework with Multiple Distributed File Systems
    Zhang, Lidong
    Wu, Yongwei
    Xue, Ruini
    Hsu, Tse-Chuan
    Yang, Hongji
    Chung, Yeh-Ching
    2017 IEEE 41ST ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 1, 2017, : 796 - 805
  • [45] Improving the performance of protograph LDPC codes by using different transmission energies
    Richter, Gerd
    Bossert, Martin
    2007 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS, VOLS 1-7, 2007, : 2251 - 2255
  • [46] On Codes with Availability for Distributed Storage
    Rawat, Ankit Singh
    Papailiopoulos, Dimitris S.
    Dimakis, Alexandros G.
    Vishwanath, Sriram
    2014 6TH INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS, CONTROL AND SIGNAL PROCESSING (ISCCSP), 2014, : 15 - 18
  • [47] Performance Enhancement of MC-CDMA System Using LDPC Codes
    Rasadurai, K.
    Kumar, Parvathy S.
    Kumaratharan, N.
    2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES (ICT 2013), 2013, : 78 - 82
  • [48] Optimal Codes for Distributed Storage
    Ren, Jian
    Li, Jian
    Li, Tongtong
    2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 42 - 46
  • [49] Implementation of Distributed File Storage and Access Framework using IPFS and Blockchain
    Kumar, Randhir
    Tripathi, Rakesh
    2019 FIFTH INTERNATIONAL CONFERENCE ON IMAGE INFORMATION PROCESSING (ICIIP 2019), 2019, : 246 - 251
  • [50] Design of Low-Delay Distributed Joint Source-Channel Codes Using Irregular LDPC Codes
    Shahid, Iqbal
    Yahampath, Pradeepa
    2012 IEEE VEHICULAR TECHNOLOGY CONFERENCE (VTC FALL), 2012,
12345