THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING

被引：0
|
作者：
Ponnavaikko, Kovendhan [1 ]
Janakiram, D. [1 ]
机构：
[1] Indian Inst Technol Madras, Dept Comp Sci & Engn, Distributed & Object Syst Lab, Madras, Tamil Nadu, India
来源：
SCALABLE COMPUTING-PRACTICE AND EXPERIENCE | 2009年 / 10卷 / 01期
关键词：
distributed file systems; high performance computing; peer-to-peer systems; scalability;
D O I：
暂无
中图分类号：
TP31 [计算机软件];
学科分类号：
081202 ; 0835 ;
摘要：
The concept of using Internet edge nodes for High Performance Computing (HPC) applications has gained acceptance in recent times. Many of these HPC applications also have large I/O requirements. Consequently, an edge node file system that efficiently manages the large number of files involved can assist in improving application performance significantly. In this paper, we discuss the design of a Distributed File System (DFS) specialized for HPC applications that exploits the storage, computation and communication capabilities of Internet edge nodes and empowers users with the autonomy to flex file management strategies to suit their needs.
引用
收藏
页码：115 / 130
页数：16
相关论文
共 50 条
  • [1] Optimizing the Ceph Distributed File System for High Performance Computing
    Jeong, Kisik
    Duffy, Carl
    Kim, Jin-Soo
    Lee, Joonwon
    [J]. 2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP), 2019, : 446 - 451
  • [2] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    [J]. International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [3] Fastdfs: A high performance distributed file system
    [J]. Liu, Xiaoyan, 1741, ICIC Express Letters Office (05):
  • [4] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    [J]. INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [5] HybridFS - A High Performance and Balanced File System Framework with Multiple Distributed File Systems
    Zhang, Lidong
    Wu, Yongwei
    Xue, Ruini
    Hsu, Tse-Chuan
    Yang, Hongji
    Chung, Yeh-Ching
    [J]. 2017 IEEE 41ST ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 1, 2017, : 796 - 805
  • [6] SCALE AND PERFORMANCE IN A DISTRIBUTED FILE SYSTEM
    HOWARD, JH
    KAZAR, ML
    MENEES, SG
    NICHOLS, DA
    SATYANARAYANAN, M
    SIDEBOTHAM, RN
    WEST, MJ
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1988, 6 (01): : 51 - 81
  • [7] Performance Evaluation and Tuning for MapReduce Computing in Hadoop Distributed File System
    Kim, Jongyeop
    Kumar, Ashwin T. K.
    George, K. M.
    Park, Nohpill
    [J]. PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2015, : 62 - 68
  • [8] Expectations of the High Performance Computing Cluster File System Selection
    Aladyshev, O. S.
    Shabanov, B. M.
    Zakharchenko, A. V.
    [J]. LOBACHEVSKII JOURNAL OF MATHEMATICS, 2023, 44 (12) : 5132 - 5147
  • [9] Expectations of the High Performance Computing Cluster File System Selection
    O. S. Aladyshev
    B. M. Shabanov
    A. V. Zakharchenko
    [J]. Lobachevskii Journal of Mathematics, 2023, 44 : 5132 - 5147
  • [10] Performance Analysis of Hadoop Distributed File System Writing File Process
    Xie, Yunyue
    Farhan, Abobaker Mohammed Qasem
    Zhou, Meihua
    [J]. 2018 INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS), 2018, : 116 - 120
12345