Improving Accessing Efficiency of Cloud Storage Using De-Duplication and Feedback Schemes

被引:15
|
作者
Wu, Tin-Yu [1 ]
Pan, Jeng-Shyang [2 ]
Lin, Chia-Fan [3 ]
机构
[1] Natl Ilan Univ, Dept Comp Sci & Informat Engn, Ilan 26047, Taiwan
[2] Shenzhen Grad Sch, Harbin Inst Technol, Shenzhen 51800, Peoples R China
[3] Tamkang Univ, Dept Elect Engn, New Taipei City 25137, Taiwan
来源
IEEE SYSTEMS JOURNAL | 2014年 / 8卷 / 01期
关键词
Cloud storage; de-duplication; hash code; load balancing; ALGORITHM; SYSTEM;
D O I
10.1109/JSYST.2013.2256715
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
File distribution and storage in a cloud storage environment is usually handled by storage device providers or physical storage devices rented from third parties. Files can be integrated into useful resources that users are then able to access via centralized management and virtualization. Nevertheless, when the number of files continues to increase, the condition of every storage node cannot be guaranteed by the manager. High volumes of files will result in wasted hardware resources, increased control complexity of the data center, and a less efficient cloud storage system. Therefore, in order to reduce workloads due to duplicate files, we propose the index name servers (INS) to manage not only file storage, data de-duplication, optimized node selection, and server load balancing, but also file compression, chunk matching, real-time feedback control, IP information, and busy level index monitoring. To manage and optimize the storage nodes based on the client-side transmission status by our proposed INS, all nodes must elicit optimal performance and offer suitable resources to clients. In this way, not only can the performance of the storage system be improved, but the files can also be reasonably distributed, decreasing the workload of the storage nodes.
引用
下载
收藏
页码:208 / 218
页数:11
相关论文
共 50 条
  • [41] Index of meta-data set of the similar files for inline de-duplication in distributed storage systems
    Sun, Jing
    Yu, Hongliang
    Zheng, Weimin
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2013, 50 (01): : 197 - 205
  • [42] SECURED AND RELIABLE FILE SHARING SYSTEM WITH DE-DUPLICATION USING ERASURE CORRECTION CODE
    Jacob, Chippy
    Rekha, V. R.
    2017 INTERNATIONAL CONFERENCE ON NETWORKS & ADVANCES IN COMPUTATIONAL TECHNOLOGIES (NETACT), 2017, : 221 - 228
  • [43] Large-Scale Data Management System Using Data De-duplication System
    Abirami, S.
    Vikraman, Rashmi
    Murugappan, S.
    PROCEEDINGS OF THE SECOND INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION TECHNOLOGIES, IC3T 2015, VOL 1, 2016, 379 : 225 - 234
  • [44] Decentralized and Privacy Sensitive Data De-Duplication Framework for Convenient Big Data Management in Cloud Backup Systems
    Jeslin, J. Gnana
    Kumar, P. Mohan
    SYMMETRY-BASEL, 2022, 14 (07):
  • [45] Improving efficiency of remote data audit for cloud storage
    Fan, Kuan
    Liu, Mingxi
    Shi, Wenbo
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2019, 13 (04): : 2198 - 2222
  • [46] De-duplication using automated face recognition: a mathematical model and all babies are equally cute
    Spreeuwers, Luuk
    2017 INTERNATIONAL CONFERENCE OF THE BIOMETRICS SPECIAL INTEREST GROUP (BIOSIG), 2017,
  • [47] Class Based Dynamic Feature Centric Data De-duplication Scheme for Efficient Mitigation of Side Channel Attack in Cloud
    Narayana, K. E.
    Jayashree, K.
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2024, 19 (03) : 1933 - 1942
  • [48] R-ADMAD: High Reliability Provision for Large-Scale De-duplication Archival Storage Systems
    Liu, Chuanyi
    Gu, Yu
    Sun, Linchun
    Yan, Bin
    Wang, Dongsheng
    ICS'09: PROCEEDINGS OF THE 2009 ACM SIGARCH INTERNATIONAL CONFERENCE ON SUPERCOMPUTING, 2009, : 370 - 379
  • [49] Class Based Dynamic Feature Centric Data De-duplication Scheme for Efficient Mitigation of Side Channel Attack in Cloud
    K. E. Narayana
    K. Jayashree
    Journal of Electrical Engineering & Technology, 2024, 19 : 1933 - 1942
  • [50] A survey on DE – Duplication schemes in cloud servers for secured data analysis in various applications
    Pragash K.
    Jayabharathy J.
    Measurement: Sensors, 2022, 24