Distributed Storage Hash Algorithm (DSHA) for File-Based Deduplication in Cloud Computing

被引:0
|
作者
Hema, S. [1 ]
Kangaiammal, A. [1 ]
机构
[1] Govt Arts Coll Autonomous, Salem 7, India
关键词
Deduplication; Chunking; MD5; SHA-1; Bloom filter;
D O I
10.1007/978-3-030-37051-0_64
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Increasing volume of digital data in cloud storage demands more storage space and efficient technique to handle these data. Duplicate is unavoidable while handling huge volume of data. Data Deduplication is an efficient approach in cloud storage environment that utilizes different techniques to deal with duplicate data. Existing systems generate the hash value by using any kind of cryptographic hash algorithms such as MD5 or Secure hash algorithms to implement the De-duplication approach. These algorithms produce fixed length of 128 bit or 160 bit as output respectively in order to identify the presence of duplication. So, an additional memory space is used to store this hash value. In this paper, an efficient Distributed Storage Hash Algorithm (DSHA) has been proposed to lessen the memory space occupied by the hash value which is utilized to identify and discard redundant data in cloud. Experimental analysis shows that the proposed strategy, reduces memory utilization of hash value and improves data read/write performance.
引用
收藏
页码:572 / 581
页数:10
相关论文
共 50 条
  • [1] Merkle Hash Tree based Deduplication in Cloud Storage
    Li, Chaoling
    Chen, Yue
    [J]. MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 6223 - 6227
  • [2] File Deduplication with Cloud Storage File System
    Ku, Chan-I
    Luo, Guo-Heng
    Chang, Che-Pin
    Yuan, Shyan-Ming
    [J]. 2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013), 2013, : 280 - 287
  • [3] Effectiveness of file-based deduplication in digital forensics
    Neuner, Sebastian
    Schmiedecker, Martin
    Weippl, Edgar
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2016, 9 (15) : 2876 - 2885
  • [4] Hash-Indexing Block-Based Deduplication Algorithm for Reducing Storage in the Cloud
    Viji D.
    Revathy S.
    [J]. Computer Systems Science and Engineering, 2023, 46 (01): : 27 - 42
  • [5] Efficient and Secure File Deduplication in Cloud Storage
    Shin, Youngjoo
    Kim, Kwangjo
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2014, E97D (02): : 184 - 197
  • [6] Cloud Based Storage System using Secure Deduplication and File Compression
    Sukruti, Gajare B.
    Rubeena, Khan A.
    [J]. 2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,
  • [7] Digital Storage in File-Based Workflows
    Coughlin, Thomas
    [J]. SMPTE MOTION IMAGING JOURNAL, 2012, 121 (06): : 77 - 82
  • [8] A Data Structure for Efficient File Deduplication in Cloud Storage
    Wang, Bohui
    Li, Hui
    Zhao, Yan
    Yang, Xin
    Ma, Huajun
    Xie, Xin
    Xing, Kaixuan
    [J]. 2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 71 - 77
  • [9] An Encrypted File Deduplication Scheme with Permission in Cloud Storage
    Deng, Zuojie
    Tan, Xiaolan
    Chen, Shuhong
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2018, 2018
  • [10] A Distributed File-Based Storage System for Improving High Availability of Space Weather Data
    Andrian, Yoga
    Kim, Hyeonwoo
    Ju, Hongtaek
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (23):