De-duplication in File Sharing Network

被引:0
|
作者
Yadav, Divakar [1 ]
Dani, Deepali [1 ]
Kumari, Preeti [1 ]
机构
[1] Jaypee Inst Informat Technol, Noida, India
来源
CONTEMPORARY COMPUTING | 2011年 / 168卷
关键词
De-duplication; three-tier architecture; Hash Algorithm; Bandwidth conservation; Storage reduction;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Redundant data transfer over a network is one of the important reasons of traffic congestion today. In this paper, we proposed an efficient and secure file sharing model using de-duplication technology to resolve it. A file sharing based de-duplication system reduce bandwidth and storage at both client and server machine. It does not download duplicate blocks that already have been downloaded. To achieve the security of client data, three-tier architecture is proposed in this work. For this purpose SHA-1 hash function is being used, in which 8KB block of data is converted into a 20 bytes digest. Thus the design presents a dramatic reduction in storage space requirement for various workloads and hence reduces time to perform backup in bandwidth constraint environment.
引用
收藏
页码:551 / 553
页数:3
相关论文
共 50 条
  • [11] A Novel and Efficient De-duplication System For HDFS
    Ranjitha, S.
    Sudhakar, P.
    Seetharaman, K. S.
    2ND INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING, COMMUNICATION & CONVERGENCE, ICCC 2016, 2016, 92 : 498 - 505
  • [12] Finite State Automata Based Cryptosystem for Secure Data Sharing and De-duplication in Cloud Computing
    Basappa B. Kodada
    Demian Antony D’Mello
    D. K. Santhosh Kumar
    SN Computer Science, 5 (6)
  • [13] Research on Chunking Algorithms of Data De-duplication
    Bo, Cai
    Li, Zhang Feng
    Can, Wang
    PROCEEDINGS OF THE 2012 INTERNATIONAL CONFERENCE ON COMMUNICATION, ELECTRONICS AND AUTOMATION ENGINEERING, 2013, 181 : 1019 - 1025
  • [14] Article De-duplication Using Distributed Representations
    Okura, Shumpei
    Tagami, Yukihiro
    Tajima, Akira
    PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'16 COMPANION), 2016, : 87 - 88
  • [15] An incremental clustering scheme for data de-duplication
    Gianni Costa
    Giuseppe Manco
    Riccardo Ortale
    Data Mining and Knowledge Discovery, 2010, 20 : 152 - 187
  • [16] An incremental clustering scheme for data de-duplication
    Costa, Gianni
    Manco, Giuseppe
    Ortale, Riccardo
    DATA MINING AND KNOWLEDGE DISCOVERY, 2010, 20 (01) : 152 - 187
  • [17] User-aware de-duplication algorithm
    School of Computer, Wuhan University, Wuhan
    430072, China
    不详
    518219, China
    不详
    410000, China
    Ruan Jian Xue Bao, 10 (2581-2595):
  • [18] Semi-supervised clustering for de-duplication
    Kushagra, Shrinu
    Ben-David, Shai
    Ilyas, Ihab F.
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [19] Exploring the Reference Management in Parallel De-duplication
    Zhu, Rui
    Qin, Lei-hua
    Zhou, Jing-li
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4, 2013, 411-414 : 236 - 239
  • [20] Hypervisor Support for Efficient Memory De-duplication
    Pan, Ying-Shiuan
    Chiang, Jui-Hao
    Li, Han-Lin
    Tsao, Po-Jui
    Lin, Ming-Fen
    Chiueh, Tzi-cker
    2011 IEEE 17TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2011, : 33 - 39