A Small File Performance Optimization Algorithm on P2P Distributed File System

被引:0
|
作者
Zhang, Yuchang [1 ]
Zhang, Qifei [1 ]
Chen, Yingzhuang [1 ]
Tu, Chaofan [1 ]
Liu, Erteng [1 ]
Ren, Jie [1 ]
Xue, Yinchao [1 ]
机构
[1] Zhejiang Univ, Sch Software Technol, Ningbo 315103, Zhejiang, Peoples R China
关键词
Small files merging; Peer to peer (P2P) structure; Storage system; Throughput rate;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the further development of the Internet, the amount of data on the network grows exponentially in recent years. While the fastest increasing objects are the mass small files from blogs, forums, etc. Master/Slave structure distributed file systems have some shortcomings, such as the poor access performance with small files, single-point bottlenecks, etc. Although these problems have been solved in the P2P structure distributed file system to some extent, there is still some improvement room of accessing performance for small files in the P2P structure distributed file system, so a small file merging strategy(SFMS) is proposed in this paper. The throughput rate of reading small files is increased significantly. Experiments show that the throughput rate of reading small files is increased by 90% compared with the original system, and 25 times higher than the TFS which is based on Master/Slave structure.
引用
收藏
页码:487 / 492
页数:6
相关论文
共 50 条
  • [31] Efficient and Effective File Replication in Structured P2P File Sharing Systems
    Shen, Haiying
    2009 IEEE NINTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING (P2P 2009), 2009, : 159 - 162
  • [32] A New Statistical Approach to Estimate Global File Populations in the eDonkey P2P File Sharing System
    Petrovic, Sanja
    Brown, Patrick
    2009 21ST INTERNATIONAL TELETRAFFIC CONGRESS (ITC 21), 2009, : 247 - 254
  • [33] The Delay Region for P2P File Transfer
    Wu, Yunnan
    Hu, Y. Charlie
    Li, Jin
    Chou, Philip A.
    2009 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, VOLS 1- 4, 2009, : 834 - +
  • [34] Pollution in P2P file sharing systems
    Liang, J
    Kumar, R
    Xi, YJ
    Ross, KW
    IEEE INFOCOM 2005: THE CONFERENCE ON COMPUTER COMMUNICATIONS, VOLS 1-4, PROCEEDINGS, 2005, : 1174 - 1185
  • [35] Modeling and simulation of P2P file pollution
    Department of Electronic Engineering, Shanghai Jiaotong University, Shanghai 200240, China
    Shanghai Jiaotong Daxue Xuebao, 2008, 2 (239-244):
  • [36] Reliable P2P file sharing service
    Shin, Jung-Hwa
    Shin, Weon
    Rhee, Kyung-Hyune
    AGENTS AND PEER-TO-PEER COMPUTING, 2008, 4461 : 143 - +
  • [37] A Method of Identifying the P2P File Sharing
    Chen, Jian-Bo
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2010, 10 (11): : 111 - 115
  • [38] The power of P2P beyond file sharing
    Zhang, XD
    25th IEEE International Conference on Distributed Computing Systems Workshops, Proceedings, 2005, : 781 - 781
  • [39] Closed P2P system for PVR-based file sharing
    Oh, S
    Kim, JS
    Kong, KS
    Lee, J
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2005, 51 (03) : 900 - 907
  • [40] Research on the Epidemic Model in P2P File-sharing System
    Yang, Wei
    Ying, Wei
    Chang, Gui-ran
    Zhang, Zhuo-qun
    HIS 2009: 2009 NINTH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS, VOL 2, PROCEEDINGS, 2009, : 386 - +