A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [1] The Data Redundancy Method for Distributed Storage based on Erasure Code
    Li, Zhi
    Pan, Chao
    MIPPR 2015: REMOTE SENSING IMAGE PROCESSING, GEOGRAPHIC INFORMATION SYSTEMS, AND OTHER APPLICATIONS, 2015, 9815
  • [2] A Method for Storage Node Allocation in Erasure Code based Storage Systems.
    Lee, Ojus Thomas
    Akash, G. J.
    Kumar, S. D. Madhu
    Chandran, Priya
    2017 IEEE 3RD INTERNATIONAL CONFERENCE ON COLLABORATION AND INTERNET COMPUTING (CIC), 2017, : 449 - 454
  • [3] Blockchain Storage Optimization Based on Erasure Code
    Fan Y.-Q.
    Sheng D.
    Wang L.-F.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (04): : 858 - 876
  • [4] Adaptive erasure code based distributed storage systems
    Rai, Brijesh Kumar
    2015 IEEE 14TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2015, : 174 - 177
  • [5] Evaluation of Performance Parameters of Heterogeneous Storage Cluster using RAID and Erasure Code
    Shinde, Pallavi Babasaheb
    Pote, Santoshi
    Bokare, Shreya
    2017 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION, CONTROL AND AUTOMATION (ICCUBEA), 2017,
  • [6] An Erasure Code Based Wireless Distributed Storage System Implementation
    Wu, Jiajia
    Wang, Li
    Hua, Chu
    Zhao, Wei
    Wang, Ge
    Chuan, Jianbin
    2018 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2018, : 730 - 731
  • [7] Erasure code-based low storage blockchain node
    Perard, Doriane
    Lacan, Jerome
    Bachy, Yann
    Detchart, Jonathan
    IEEE 2018 INTERNATIONAL CONGRESS ON CYBERMATICS / 2018 IEEE CONFERENCES ON INTERNET OF THINGS, GREEN COMPUTING AND COMMUNICATIONS, CYBER, PHYSICAL AND SOCIAL COMPUTING, SMART DATA, BLOCKCHAIN, COMPUTER AND INFORMATION TECHNOLOGY, 2018, : 1622 - 1627
  • [8] Supporting heterogeneous pools in a single Ceph storage cluster
    Meyer, Stefan
    Morrison, John P.
    2015 17TH INTERNATIONAL SYMPOSIUM ON SYMBOLIC AND NUMERIC ALGORITHMS FOR SCIENTIFIC COMPUTING (SYNASC), 2016, : 352 - 359
  • [9] Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems
    Ojus Thomas Lee
    G. J. Akash
    S. D. Madhu Kumar
    Priya Chandran
    Arabian Journal for Science and Engineering, 2019, 44 : 9127 - 9142
  • [10] Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems
    Lee, Ojus Thomas
    Akash, G. J.
    Kumar, S. D. Madhu
    Chandran, Priya
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2019, 44 (11) : 9127 - 9142