Research of the Strategy to Improve the Hadoop Distributed File System Downloading Performance

被引：0
|
作者：
Ge Junwei [1 ]
Jiang Renxiang [1 ]
机构：
[1] Chongqing Univ Posts & Telecommun, Chongqing, Peoples R China
来源：
ELECTRONIC INFORMATION AND ELECTRICAL ENGINEERING | 2012年 / 19卷
关键词：
cloud computing; hadoop distributed file system; parallel download; load balancing;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
This paper introduced the process of client downloading files from the Hadoop distributed file system, in the process of downloading files were studied for the user experience is poor and possible load imbalance problem, proposed a parallel download programs, and in the process of downloading data blocks from multiple backup data storage Datallodes, used an improved rate of adaptive dynamic parallel downloading mechanism. Experimental results show that the improved download strategy greatly reduces the waiting time of the client downloading files from the Hadoop distributed file system. Parallel download can improve Hadoop distributed file system download efficiency and make the Datallode more balanced load.
引用
收藏
页码：244 / 247
页数：4
相关论文
共 50 条
  • [1] Research on Distributed File System with Hadoop
    Xu, JunWu
    Liang, JunLing
    [J]. NETWORK COMPUTING AND INFORMATION SECURITY, 2012, 345 : 148 - +
  • [2] Research on reliability of hadoop distributed file system
    College of Computer Science and Technology, Harbin University of Science and Technology, Harbin, China
    [J]. Int. J. Multimedia Ubiquitous Eng., 11 (315-326):
  • [3] High Performance Hadoop Distributed File System
    Elkawkagy, Mohamed
    Elbeh, Heba
    [J]. INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2020, 8 (03) : 119 - 123
  • [4] High Performance Hadoop Distributed File System
    Mohamed Elkawkagy
    Heba Elbeh
    [J]. International Journal of Networked and Distributed Computing, 2020, 8 : 119 - 123
  • [5] Performance Analysis of Hadoop Distributed File System Writing File Process
    Xie, Yunyue
    Farhan, Abobaker Mohammed Qasem
    Zhou, Meihua
    [J]. 2018 INTERNATIONAL CONFERENCE ON INTELLIGENT AUTONOMOUS SYSTEMS (ICOIAS), 2018, : 116 - 120
  • [6] The Hadoop Distributed File System
    Shvachko, Konstantin
    Kuang, Hairong
    Radia, Sanjay
    Chansler, Robert
    [J]. 2010 IEEE 26TH SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2010,
  • [7] Performance Study on Indexing and Accessing of Small File in Hadoop Distributed File System
    Rodrigues, Anisha P.
    Fernandes, Roshan
    Vijaya, P.
    Chander, Satish
    [J]. JOURNAL OF INFORMATION & KNOWLEDGE MANAGEMENT, 2021, 20 (04)
  • [8] Research of Cloud Storage Based on Hadoop Distributed File System
    Han, Yongqi
    Zhang, Yun
    Yu, Shui
    [J]. APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 2472 - 2475
  • [9] Hadoop Distributed File System for the Grid
    Attebury, Garhan
    Baranovski, Andrew
    Bloom, Ken
    Bockelman, Brian
    Kcira, Dorian
    Letts, James
    Levshina, Tanya
    Lundestedt, Carl
    Martin, Terrence
    Maier, Will
    Pi, Haifeng
    Rana, Abhishek
    Sfiligoi, Igor
    Sim, Alexander
    Thomas, Michael
    Wuerthwein, Frank
    [J]. 2009 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2009, : 1056 - +
  • [10] The Evolution of the Hadoop Distributed File System
    Maneas, Stathis
    Schroeder, Bianca
    [J]. 2018 32ND INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS WORKSHOPS (WAINA), 2018, : 67 - 74
12345