A Small File Performance Optimization Algorithm on P2P Distributed File System

被引:0
|
作者
Zhang, Yuchang [1 ]
Zhang, Qifei [1 ]
Chen, Yingzhuang [1 ]
Tu, Chaofan [1 ]
Liu, Erteng [1 ]
Ren, Jie [1 ]
Xue, Yinchao [1 ]
机构
[1] Zhejiang Univ, Sch Software Technol, Ningbo 315103, Zhejiang, Peoples R China
关键词
Small files merging; Peer to peer (P2P) structure; Storage system; Throughput rate;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the further development of the Internet, the amount of data on the network grows exponentially in recent years. While the fastest increasing objects are the mass small files from blogs, forums, etc. Master/Slave structure distributed file systems have some shortcomings, such as the poor access performance with small files, single-point bottlenecks, etc. Although these problems have been solved in the P2P structure distributed file system to some extent, there is still some improvement room of accessing performance for small files in the P2P structure distributed file system, so a small file merging strategy(SFMS) is proposed in this paper. The throughput rate of reading small files is increased significantly. Experiments show that the throughput rate of reading small files is increased by 90% compared with the original system, and 25 times higher than the TFS which is based on Master/Slave structure.
引用
收藏
页码:487 / 492
页数:6
相关论文
共 50 条
  • [1] IgorFs: A Distributed P2P File System
    Amann, Bernhard
    Elser, Benedikt
    Houri, Yaser
    Fuhrmann, Thomas
    P2P'08: EIGHTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING, PROCEEDINGS, 2008, : 77 - 78
  • [2] Cloud storage system for small file based on P2P
    Pan, X.-Z. (xzpan@cs.zju.edu.cn), 1600, Zhejiang University (47):
  • [3] Distributed path restoration algorithm for anonymity in P2P file sharing systems
    Manzanares-Lopez, Pilar
    Munoz-Gea, Juan Pedro
    Malgosa-Sanahuja, Josemaria
    Sanchez-Aamoutse, Juan Carlos
    Garcia-Haro, Joan
    ICSOFT 2007: PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON SOFTWARE AND DATA TECHNOLOGIES, VOL PL/DPS/KE/MUSE, 2007, : 88 - 95
  • [4] Distributed, automatic file descriptor tuning in P2P file-sharing systems
    Jia, Dongmei
    Yee, Wai Gen
    Nguyen, Linh Thai
    Frieder, Ophir
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2008, 1 (02) : 148 - 161
  • [5] Distributed, automatic file descriptor tuning in P2P file-sharing systems
    Dongmei Jia
    Wai Gen Yee
    Linh Thai Nguyen
    Ophir Frieder
    Peer-to-Peer Networking and Applications, 2008, 1 : 148 - 161
  • [6] Incentive mechanism algorithm for P2P file system in campus networks
    Yu, Fanpeng
    Zhang, Sidong
    Zhou, Xin
    Telkomnika, 2012, 10 (06): : 1477 - 1484
  • [7] Analyzing the file availability and download time in a P2P file sharing system
    Susitaival, Riikka
    Aalto, Samuli
    2007 NEXT GENERATION INTERNET NETWORKS, 2007, : 88 - +
  • [8] An Efficient and Adaptive Decentralized File Replication Algorithm in P2P File Sharing Systems
    Shen, Haiying
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2010, 21 (06) : 827 - 840
  • [9] A UDP based protocol for distributed P2P file sharing
    Lien, Yao-Nan
    Xu, Hong-Qi
    EIGHTH INTERNATIONAL SYMPOSIUM ON AUTONOMOUS DECENTRALIZED SYSTEMS, PROCEEDINGS, 2007, : 318 - +
  • [10] Distributed network file storage for a serverless (P2P) network
    Ye, W
    Khan, AI
    Kendall, EA
    ICON 2003: 11TH IEEE INTERNATIONAL CONFERENCE ON NETWORKS, 2003, : 343 - 347