A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [41] Storage and retrieval of massive heterogeneous IoT data based on hybrid storage
    Wu, Shanshan
    Bao, Liang
    Zhu, Zisheng
    Yi, Fan
    Chen, Weizhao
    2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017, : 2982 - 2987
  • [42] Design for the erasure code based segmented File P2P storage structure
    College of Information System and Management, National Univ. of Defense Technology, Changsha 410073, China
    Guofang Keji Daxue Xuebao/Journal of National University of Defense Technology, 2008, 30 (06): : 57 - 62
  • [43] EA-EO : Endurance Aware Erasure Code for SSD-based Storage Systems
    Chamazcoti, Saeideh Alinezhad
    Miremadi, Seyed Ghassem
    2014 20TH IEEE PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING (PRDC 2014), 2014, : 76 - 85
  • [44] Current Status of the Ceph Based Storage Systems at the RACF
    Zaytsevl, A.
    Ito, H.
    Hollowell, C.
    Wong, T.
    Rao, T.
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [45] A Cross-Datacenter Erasure Code Writing Method Based on Generator Matrix Transformation
    Bao H.
    Wang Y.
    Xu F.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (02): : 291 - 305
  • [46] An Adaptive Erasure Code for JointCloud Storage of Internet of Things Big Data
    Bao, Han
    Wang, Yijie
    Xu, Fangliang
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (03): : 1613 - 1624
  • [47] QS-Code: A Quasi-Systematic Erasure Code with Partial Security for Cloud Storage
    Wang, Chong
    Zhou, Ke
    Wei, Ronglei
    CLOUD COMPUTING AND SECURITY, PT III, 2018, 11065 : 206 - 216
  • [48] A Novel Completely Local Repairable Code Algorithm Based on Erasure Code
    Fang, Ying
    Tan, Hai
    Wang, Shuaifang
    Zhang, Xin
    Liao, Gejian
    Zhang, Jun
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2022, 29 (05): : 1658 - 1664
  • [49] Feasibility Study of Location-Conscious Multi-Site Erasure-Coded Ceph Storage for Disaster Recovery
    Uehara, Keitaro
    Chen, Yih-Farn Robin
    Hiltunen, Matti
    Joshi, Kaustubh
    Schlichting, Richard
    2018 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2018), 2018, : 204 - 210
  • [50] Research on Hybrid Storage Method of Massive Heterogeneous Data for Mobile Environment
    Wu, Shanshan
    Yi, Fan
    ADVANCES IN COMPUTER SCIENCE AND UBIQUITOUS COMPUTING, 2018, 474 : 631 - 640