Quantification and analysis of performance fluctuation in distributed file system

被引:0
|
作者
Zhang, Yuchen [1 ]
Zhang, Xiao [1 ]
Yu, Jinyang [1 ]
Shi, Yulong [1 ]
Su, Linxuan [1 ]
机构
[1] Northwestern Polytech Univ, IT Acad, Dong Xiang Rd, Xian 710129, Shaanxi, Peoples R China
关键词
Distributed file system; Performance fluctuations; Quantitative analysis; Ceph;
D O I
10.1007/s10586-023-04141-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Performance is a key requirement in quality of service for cloud storage system users. Cloud storage system is complex, so the performance results may be different even under exact same experimental conditions. Many benchmarks are developed to measure performance, but there are only several research focus on performance fluctuations. In this paper, we present a generic method and two metrics to measure the performance fluctuations of a distributed file system. It analyzes the IO path and finds related factors such as storage media, network, configurations and software components. We tested the performance fluctuations of Ceph under different storage media HDD, SSD, and different workloads Webserver, Fileserver, and Mailserver. We adjust the software configuration and software components to reduce the performance fluctuations. By using Filestore, it reduces 85.4% performance fluctuations than Filestore. By using EXT4 instead of XFS, it reduces performance fluctuations by 33.2%. But reducing performance fluctuations of lower components does not always reduce the performance fluctuation of distributed file system. We reduced the performance fluctuation of the local file system by 80.7%, but the performance fluctuation of DFS by 38.0%.
引用
收藏
页码:3149 / 3162
页数:14
相关论文
共 50 条
  • [1] Performance Analysis of Hadoop Distributed File System Writing File Process
    Xie, Yunyue
    Farhan, Abobaker Mohammed Qasem
    Zhou, Meihua
    [J]. 2018 INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS), 2018, : 116 - 120
  • [2] Design and Performance Analysis of File Replication Strategy on Distributed File System Using GridSim
    Singh, Nirmal
    Singh, Sarbjeet
    [J]. ICT AND CRITICAL INFRASTRUCTURE: PROCEEDINGS OF THE 48TH ANNUAL CONVENTION OF COMPUTER SOCIETY OF INDIA - VOL I, 2014, 248 : 629 - 637
  • [3] SCALE AND PERFORMANCE IN A DISTRIBUTED FILE SYSTEM
    HOWARD, JH
    KAZAR, ML
    MENEES, SG
    NICHOLS, DA
    SATYANARAYANAN, M
    SIDEBOTHAM, RN
    WEST, MJ
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 1988, 6 (01): : 51 - 81
  • [4] THE EDGE NODE FILE SYSTEM: A DISTRIBUTED FILE SYSTEM FOR HIGH PERFORMANCE COMPUTING
    Ponnavaikko, Kovendhan
    Janakiram, D.
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2009, 10 (01): : 115 - 130
  • [5] Fastdfs: A high performance distributed file system
    [J]. Liu, Xiaoyan, 1741, ICIC Express Letters Office (05):
  • [6] A BENCHMARK FOR PERFORMANCE EVALUATION OF A DISTRIBUTED FILE SYSTEM
    HAC, A
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 1989, 9 (04) : 273 - 285
  • [7] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    [J]. International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [8] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    [J]. INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [9] Performance Analysis of Distributed File System Based on RAID Storage for Tapeless Storage
    Kim, Jungbin
    Yu, Hyeon-Jin
    Kang, Hyeongbin
    Shin, Jae-Hyuck
    Jeong, Heeseok
    Noh, Seo-Young
    [J]. IEEE ACCESS, 2023, 11 : 116153 - 116168
  • [10] Performance Study on Indexing and Accessing of Small File in Hadoop Distributed File System
    Rodrigues, Anisha P.
    Fernandes, Roshan
    Vijaya, P.
    Chander, Satish
    [J]. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2021, 20 (04)