A Novel Frequency Based Chunking for Data Deduplication

被引：0
|
作者：
Zhang, Yunhe [1 ]
Wang, Weiling [1 ]
Yin, Ting [1 ]
Yuan, Jiang [1 ]
机构：
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Peoples R China
来源：
ADVANCES IN MECHATRONICS AND CONTROL ENGINEERING, PTS 1-3 | 2013年 / 278-280卷
关键词：
Data de-duplication; FBC algorithm; IFBC algorithm;
D O I：
10.4028/www.scientific.net/AMM.278-280.2048
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Invoked by the thought of hierarchical substring caching, we proposed a novel Improved Frequency Based Chunking (called IFBC) algorithm for data de-duplication, based on the FBC algorithm proposed in Frequency Based Chunking for Data De-Duplication. Then we conducted a lot of experiments and proved that the IFBC algorithm has a great improvement on the performance compared with the FBC algorithm.
引用
收藏
页码：2048 / 2053
页数：6
相关论文
共 50 条
  • [1] Data Deduplication Using Dynamic Chunking Algorithm
    Moon, Young Chan
    Jung, Ho Min
    Yoo, Chuck
    Ko, Young Woong
    COMPUTATIONAL COLLECTIVE INTELLIGENCE - TECHNOLOGIES AND APPLICATIONS, PT II, 2012, 7654 : 59 - 68
  • [2] Data Deduplication System Based on Content-Defined Chunking Using Bytes Pair Frequency Occurrence
    Saeed, Ahmed Sardar M.
    George, Loay E.
    SYMMETRY-BASEL, 2020, 12 (11): : 1 - 21
  • [3] Accelerating Content-Defined Chunking for Data Deduplication Based on Speculative Jump
    Jin, Xiaozhong
    Liu, Haikun
    Ye, Chencheng
    Liao, Xiaofei
    Jin, Hai
    Zhang, Yu
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (09) : 2568 - 2579
  • [4] Accelerating content-defined-chunking based data deduplication by exploiting parallelism
    Xia, Wen
    Feng, Dan
    Jiang, Hong
    Zhang, Yucheng
    Chang, Victor
    Zou, Xiangyu
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 98 : 406 - 418
  • [5] Blockchain-based data deduplication using novel content-defined chunking algorithm in cloud environment
    Prakash, J. Jabin
    Ramesh, K.
    Saravanan, K.
    Prabha, G. Lakshmi
    INTERNATIONAL JOURNAL OF NETWORK MANAGEMENT, 2023,
  • [6] Blockchain-based data deduplication using novel content-defined chunking algorithm in cloud environment
    Prakash, Jabin J.
    Ramesh, K.
    Saravanan, K.
    Prabha, Lakshmi G.
    INTERNATIONAL JOURNAL OF NETWORK MANAGEMENT, 2023, 33 (06)
  • [7] Byte-index Chunking Algorithm for Data Deduplication System
    Lkhagvasuren, Ider
    So, Jung Min
    Lee, Jeong Gun
    Yoo, Chuck
    Ko, Young Woong
    INTERNATIONAL JOURNAL OF SECURITY AND ITS APPLICATIONS, 2013, 7 (05): : 415 - 424
  • [8] SeqCDC: Hashless Content-Defined Chunking for Data Deduplication
    Udayashankar, Sreeharsha
    Baba, Abdelrahman
    Al-Kiswany, Samer
    PROCEEDINGS OF THE TWENTY-FIFTH ACM INTERNATIONAL MIDDLEWARE CONFERENCE, MIDDLEWARE 2024, 2024, : 292 - 298
  • [9] Dynamic Prime Chunking Algorithm for Data Deduplication in Cloud Storage
    Ellappan, Manogar
    Abirami, S.
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (04): : 1342 - 1359
  • [10] The Design of Fast Content-Defined Chunking for Data Deduplication Based Storage Systems
    Xia, Wen
    Zou, Xiangyu
    Jiang, Hong
    Zhou, Yukun
    Liu, Chuanyi
    Feng, Dan
    Hua, Yu
    Hu, Yuchong
    Zhang, Yucheng
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (09) : 2017 - 2031
12345