Performance Analysis of Hadoop Distributed File System Writing File Process

被引：0
|
作者：
Xie, Yunyue [1 ]
Farhan, Abobaker Mohammed Qasem [1 ]
Zhou, Meihua [1 ]
机构：
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou 225127, Jiangsu, Peoples R China
来源：
2018 INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS) | 2018年
基金：
中国国家自然科学基金;
关键词：
Hadoop; HDFS; PEPA; Performance Analysis;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
With the Internet development, the data in the world have had a drastic increase in the past decade. Traditional IT architecture cannot meet the needs of saving and processing data, the emergence of Cloud Computing solved the problem. Hadoop is a distributed processing software architecture run on Cloud Computing platform, it can store and process big data. Hadoop Distributed File System (HDFS) and MapReduce are its two main core components, which implements distributed file storage and parallel task processing respectively. In this paper, we will model, analysis, and evaluate HDFS based on Performance Evaluation Process Algebra (PEPA).
引用
收藏
页码：116 / 120
页数：5
相关论文
共 50 条
  • [1] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    [J]. International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [2] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    [J]. INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [3] The Hadoop Distributed File System
    Shvachko, Konstantin
    Kuang, Hairong
    Radia, Sanjay
    Chansler, Robert
    [J]. 2010 IEEE 26TH SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2010,
  • [4] Performance Study on Indexing and Accessing of Small File in Hadoop Distributed File System
    Rodrigues, Anisha P.
    Fernandes, Roshan
    Vijaya, P.
    Chander, Satish
    [J]. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2021, 20 (04)
  • [5] Hadoop Distributed File System for the Grid
    Attebury, Garhan
    Baranovski, Andrew
    Bloom, Ken
    Bockelman, Brian
    Kcira, Dorian
    Letts, James
    Levshina, Tanya
    Lundestedt, Carl
    Martin, Terrence
    Maier, Will
    Pi, Haifeng
    Rana, Abhishek
    Sfiligoi, Igor
    Sim, Alexander
    Thomas, Michael
    Wuerthwein, Frank
    [J]. 2009 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2009, : 1056 - +
  • [6] The Evolution of the Hadoop Distributed File System
    Maneas, Stathis
    Schroeder, Bianca
    [J]. 2018 32ND INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS (WAINA), 2018, : 67 - 74
  • [7] Research on Distributed File System with Hadoop
    Xu, JunWu
    Liang, JunLing
    [J]. NETWORK COMPUTING AND INFORMATION SECURITY, 2012, 345 : 148 - +
  • [8] Hadoop Distributed File System for Big data analysis
    Almansouri, Hatim Talal
    Masmoudi, Youssef
    [J]. PROCEEDINGS OF 2019 IEEE 4TH WORLD CONFERENCE ON COMPLEX SYSTEMS (WCCS' 19), 2019, : 257 - 261
  • [9] Dynamic core affinity for high-performance file upload on Hadoop Distributed File System
    Cho, Joong-Yeon
    Jin, Hyun-Wook
    Lee, Min
    Schwan, Karsten
    [J]. PARALLEL COMPUTING, 2014, 40 (10) : 722 - 737
  • [10] Analytical Review on Hadoop Distributed File System
    Dwivedi, Kalpana
    Dubey, Sanjay Kumar
    [J]. 2014 5TH INTERNATIONAL CONFERENCE CONFLUENCE THE NEXT GENERATION INFORMATION TECHNOLOGY SUMMIT (CONFLUENCE), 2014, : 174 - 181
12345