A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [31] Ceph-based Storage Server Application
    Azginoglu, Nuh
    Eren, Mehmet Akif
    Celik, Mete
    Aydin, Zafer
    2018 6TH INTERNATIONAL SYMPOSIUM ON DIGITAL FORENSIC AND SECURITY (ISDFS), 2018, : 408 - 411
  • [32] On improving recovery performance in erasure code based geo-diverse storage clusters
    Caneleo, Pablo Ignacio Serrano
    Mohan, Lakshmi J.
    Parampalli, Udaya
    Harwood, Aaron
    PROCEEDINGS OF THE 2016 12TH INTERNATIONAL CONFERENCE ON THE DESIGN OF RELIABLE COMMUNICATION NETWORKS (DRCN 2016), 2016, : 123 - 129
  • [33] An Effective Integrity Check Scheme for Secure Erasure Code-Based Storage Systems
    Shen, Shiuan-Tzuo
    Lin, Hsiao-Ying
    Tzeng, Wen-Guey
    IEEE TRANSACTIONS ON RELIABILITY, 2015, 64 (03) : 840 - 851
  • [34] Preservation Mechanism of Electronic Record Based on Erasure Code and Multi Copies in Cloud Storage
    Ren, Yongjun
    Zhou, Lin
    Liu, Yepeng
    Zhang, Xiaorui
    CLOUD COMPUTING AND SECURITY, PT III, 2018, 11065 : 174 - 183
  • [35] A Secure Erasure Code-Based Cloud Storage System with Secure Data Forwarding
    Lin, Hsiao-Ying
    Tzeng, Wen-Guey
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2012, 23 (06) : 995 - 1003
  • [36] An Erasure Code With Reduced Average Locality for Distributed Storage Systems
    Shahabinejad, Mostafa
    Ardakani, Masoud
    Khabbazian, Majid
    2017 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS (ICNC), 2016, : 427 - 431
  • [37] Enabling Node Repair in Any Erasure Code for Distributed Storage
    Rashmi, K. V.
    Shah, Nihar B.
    Kumar, P. Vijay
    2011 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2011, : 1235 - 1239
  • [38] SpreadStore: A LDPC Erasure Code scheme for Distributed Storage System
    Harihara, S. G.
    Janakiram, Balaji
    Chandra, M. Girish
    Aravind, K. G.
    Kadhe, Swanand
    Balamuralidhar, P.
    Adiga, B. S.
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON DATA STORAGE AND DATA ENGINEERING (DSDE 2010), 2010, : 154 - 158
  • [39] FPGA-Accelerated Erasure Coding Encoding in Ceph Based on an Efficient Layered Strategy
    Lei, Fan
    Chen, Junqi
    Wang, Yong
    Yang, Sijie
    ELECTRONICS, 2024, 13 (03)
  • [40] Design of File Multi-Cloud Secure Storage System Based on Web and Erasure Code
    Shi, Wei
    Liu, Tenglong
    Huang, Min
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 208 - 211