Improving Accessing Efficiency of Cloud Storage Using De-Duplication and Feedback Schemes

被引:15
|
作者
Wu, Tin-Yu [1 ]
Pan, Jeng-Shyang [2 ]
Lin, Chia-Fan [3 ]
机构
[1] Natl Ilan Univ, Dept Comp Sci & Informat Engn, Ilan 26047, Taiwan
[2] Shenzhen Grad Sch, Harbin Inst Technol, Shenzhen 51800, Peoples R China
[3] Tamkang Univ, Dept Elect Engn, New Taipei City 25137, Taiwan
来源
IEEE SYSTEMS JOURNAL | 2014年 / 8卷 / 01期
关键词
Cloud storage; de-duplication; hash code; load balancing; ALGORITHM; SYSTEM;
D O I
10.1109/JSYST.2013.2256715
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
File distribution and storage in a cloud storage environment is usually handled by storage device providers or physical storage devices rented from third parties. Files can be integrated into useful resources that users are then able to access via centralized management and virtualization. Nevertheless, when the number of files continues to increase, the condition of every storage node cannot be guaranteed by the manager. High volumes of files will result in wasted hardware resources, increased control complexity of the data center, and a less efficient cloud storage system. Therefore, in order to reduce workloads due to duplicate files, we propose the index name servers (INS) to manage not only file storage, data de-duplication, optimized node selection, and server load balancing, but also file compression, chunk matching, real-time feedback control, IP information, and busy level index monitoring. To manage and optimize the storage nodes based on the client-side transmission status by our proposed INS, all nodes must elicit optimal performance and offer suitable resources to clients. In this way, not only can the performance of the storage system be improved, but the files can also be reasonably distributed, decreasing the workload of the storage nodes.
引用
下载
收藏
页码:208 / 218
页数:11
相关论文
共 50 条
  • [31] An enhanced secure content de-duplication identification and prevention (ESCDIP) algorithm in cloud environment
    J. K. Periasamy
    B. Latha
    Neural Computing and Applications, 2020, 32 : 485 - 494
  • [32] ADMAD: Application-Driven Metadata Aware De-duplication Archival Storage System
    Liu, Chuanyi
    Lu, Yingping
    Shi, Chunhui
    Lu, Guanlin
    Du, David H. C.
    Wang, Dong-Sheng
    SNAPI 2008: FIFTH IEEE INTERNATIONAL WORKSHOP ON STORAGE NETWORK ARCHITECTURE AND PARALLEL I/OS, PROCEEDINGS, 2008, : 29 - +
  • [33] Scalable Incremental Checkpointing using GPU-Accelerated De-Duplication
    Tan, Nigel
    Luettgau, Jakob
    Marquez, Jack
    Terianishi, Keita
    Morales, Nicolas
    Bhowmick, Sanjukta
    Cappello, Franck
    Taufer, Michela
    Nicolae, Bogdan
    PROCEEDINGS OF THE 52ND INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2023, 2023, : 665 - 674
  • [34] Bi-directional and concurrent proof of ownership for stronger storage services with de-duplication
    Taek-Young YOUN
    Ku-Young CHANG
    Science China(Information Sciences), 2018, 61 (03) : 84 - 94
  • [35] Bi-directional and concurrent proof of ownership for stronger storage services with de-duplication
    Youn, Taek-Young
    Chang, Ku-Young
    SCIENCE CHINA-INFORMATION SCIENCES, 2018, 61 (03)
  • [36] D4: Improving LLM Pretraining via Document De-Duplication and Diversification
    Tirumala, Kushal
    Simig, Daniel
    Aghajanyan, Armen
    Morcos, Ari S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] Finite State Automata Based Cryptosystem for Secure Data Sharing and De-duplication in Cloud Computing
    Basappa B. Kodada
    Demian Antony D’Mello
    D. K. Santhosh Kumar
    SN Computer Science, 5 (6)
  • [38] Cross-User Level De-Duplication using Distributive Soft Links
    Kumar, Ashok P. M.
    Pugazhendi, E.
    Kavitha, D.
    2017 IEEE INTERNATIONAL CONFERENCE ON POWER, CONTROL, SIGNALS AND INSTRUMENTATION ENGINEERING (ICPCSI), 2017, : 2523 - 2530
  • [39] Second Order Mutual Information based Grey Wolf Optimization for effective storage and de-duplication
    Jyoti Malhotra
    Jagdish Bakal
    Sādhanā, 2018, 43
  • [40] Second Order Mutual Information based Grey Wolf Optimization for effective storage and de-duplication
    Malhotra, Jyoti
    Bakal, Jagdish
    SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES, 2018, 43 (11):