Distributed File System: Efficiency Experiments for Data Access and Communication

被引：0
|
作者：
Upadhyaya, Bipin [1 ]
Azimov, Fahriddin [1 ]
Doan, Thanh Tran [1 ]
Choi, Eunmi [1 ]
Kim, SangBum [2 ]
Kim, Pilsung [2 ]
机构：
[1] Kookmin Univ, Sch Business IT, Seoul, South Korea
[2] SK Telecom Convergence & nternet R&D Ctr, Seoul, South Korea
来源：
NCM 2008: 4TH INTERNATIONAL CONFERENCE ON NETWORKED COMPUTING AND ADVANCED INFORMATION MANAGEMENT, VOL 2, PROCEEDINGS | 2008年
关键词：
Distributed File System; Buffer management; Disk Input/Output Performance; I/O tuning;
D O I：
10.1109/NCM.2008.164
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In a Distributed File System, operations such as read, write, send and receive should be efficient and must increase the overall performance of the system. Especially every remote read and write operation we encounter network and secondary storage latencies. In order to reduce this latency time and improve the performance of Distributed File System, we analyze the problem of selecting application-level buffer size for the Network communication and Disk Input/Output operations. A number of experiments were carried out to identify the optimal size for our application-level Buffer.
引用
收藏
页码：400 / +
页数：2
相关论文
共 50 条
  • [1] Optimization of Small Sized File Access Efficiency in Hadoop Distributed File System by Integrating Virtual File System Layer
    Alange, Neeta
    Mathur, Anjali
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) : 204 - 210
  • [2] Access efficiency of small sized files in Big Data using various Techniques on Hadoop Distributed File System platform
    Alange, Neeta
    Mathur, Anjali
    [J]. INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2021, 21 (07): : 359 - 364
  • [3] PABIRS: A Data Access Middleware for Distributed File Systems
    Wu, Sai
    Chen, Gang
    Zhou, Xianke
    Zhang, Zhenjie
    Tung, Anthony K. H.
    Winslett, Marianne
    [J]. 2015 IEEE 31ST INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2015, : 113 - 124
  • [4] Data Structures for Storing File Namespace in Distributed File System
    Long, Luu Hoang
    Choi, Eunmi
    Kim, SangBum
    Kim, Pilsung
    [J]. NCM 2008 : 4TH INTERNATIONAL CONFERENCE ON NETWORKED COMPUTING AND ADVANCED INFORMATION MANAGEMENT, VOL 1, PROCEEDINGS, 2008, : 250 - 255
  • [5] Data Security in Hadoop Distributed File System
    Shetty, Madhvaraj M.
    Manjaiah, D. H.
    [J]. IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGICAL TRENDS IN COMPUTING, COMMUNICATIONS AND ELECTRICAL ENGINEERING (ICETT), 2016,
  • [6] Effective and Scalable Data Access Control in Onedata Large Scale Distributed Virtual File System
    Wrzeszcz, Michal
    Opiola, Lukasz
    Zemek, Konrad
    Kryza, Bartosz
    Dutka, Lukasz
    Slota, Renata
    Kitowski, Jacek
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 445 - 454
  • [7] Opass: Analysis and Optimization of Parallel Data Access on Distributed File Systems
    Yin, Jiangling
    Wang, Jun
    Zhou, Jian
    Lukasiewicz, Tyler
    Huang, Dan
    Zhang, Junyao
    [J]. 2015 IEEE 29TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2015, : 623 - 632
  • [8] Achieving Load Balance for Parallel Data Access on Distributed File Systems
    Huang, Dan
    Han, Dezhi
    Wang, Jun
    Yin, Jiangling
    Chen, Xunchao
    Zhang, Xuhong
    Zhou, Jian
    Ye, Mao
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2018, 67 (03) : 388 - 402
  • [9] EGRIDER GFS: A Distributed File System with Multi-source Data Access and Replication for Grid Computing
    Chen, Chun-Ting
    Hsu, Chun-Chen
    Wu, Jan-Jan
    Liu, Pangfeng
    [J]. ADVANCES IN GRID AND PERVASIVE COMPUTING, PROCEEDINGS, 2009, 5529 : 119 - +
  • [10] An enhancement of data locality in Hadoop distributed file system
    Reddy, A. Siva Krishna
    Sujatha, Pothula
    Koti, Prasad
    Dhavachelvan, P.
    Amudhavel, J.
    [J]. BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2018, 11 (01): : 123 - 133
12345