ChewAnalyzer: Workload-Aware Data Management Across Differentiated Storage Pools

被引:4
|
作者
Ge, Xiongzi [1 ]
Xie, Xuchao [2 ]
Du, David H. C. [3 ]
Ganesan, Pradeep [1 ]
Hahn, Dennis [1 ]
机构
[1] NetApp Inc, Sunnyvale, CA 94089 USA
[2] NUDT, Changsha, Peoples R China
[3] Univ Minnesota, Minneapolis, MN 55455 USA
基金
美国国家科学基金会;
关键词
Storage; Fully connected storage; Hierarchical Classifier; Data placement; Data movement; DESIGN;
D O I
10.1109/MASCOTS.2018.00017
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In multi-tier storage systems, moving data from one tier to the next can be inefficient. And because each type of storage device has its own idiosyncrasies with respect to the workloads that it can best support, unnecessary data movement might result. In this paper, we explore a fully connected storage architecture in which data can move from any storage pool to another. We propose a Chunk-level storage-aware workload Analyzer framework, abbreviated as ChewAnalyzer, to facilitate efficient data placement. Access patterns are characterized in a flexible way by a collection of I/O accesses to a data chunk. ChewAnalyzer employs a Hierarchical Classifier [30] to analyze the chunk patterns step by step. In each classification step, the Chunk Placement Recommender suggests new data placement policies according to the device properties. Based on the analysis of access pattern changes, the Storage Manager can adequately distribute or migrate the data chunks across different storage pools. Our experimental results show that ChewAnalyzer improves the initial data placement and that it migrates data into the proper pools directly and efficiently.
引用
收藏
页码:94 / 101
页数:8
相关论文
共 50 条
  • [1] FORESEER: Workload-aware Data Storage for MapReduce
    Zou, Jia
    Shi, Juwei
    Liu, Tongping
    Cao, Zhao
    Wang, Chen
    [J]. 2015 IEEE 35th International Conference on Distributed Computing Systems, 2015, : 746 - 747
  • [2] Workload-Aware Scheduling for Data Analytics upon Heterogeneous Storage
    Qian, Zhuzhong
    Gao, Yuan
    Ji, Mingtao
    Peng, Hui
    Chen, Peng
    Jin, Yibo
    Lu, Sanglu
    [J]. 2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 580 - 587
  • [3] Efficient and Adaptable Query Workload-Aware Management for RDF Data
    MahmoudiNasab, Hooran
    Sakr, Sherif
    [J]. WEB INFORMATION SYSTEM ENGINEERING-WISE 2010, 2010, 6488 : 390 - +
  • [4] Workload-aware storage policies for cloud object storage
    Chen, Yu
    Tong, Wei
    Feng, Dan
    Wang, Zike
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2022, 163 : 232 - 247
  • [5] Workload-Aware Scheduling Across Geo-distributed Data Centers
    Jin, Yibo
    Gao, Yuan
    Qian, Zhuzhong
    Zhai, Mingyu
    Peng, Hui
    Lu, Sanglu
    [J]. 2016 IEEE TRUSTCOM/BIGDATASE/ISPA, 2016, : 1455 - 1462
  • [6] Workload-Aware Live Storage Migration for Clouds
    Zheng, Jie
    Ng, T. S. Eugene
    Sripanidkulchai, Kunwadee
    [J]. ACM SIGPLAN NOTICES, 2011, 46 (07) : 133 - 144
  • [7] A Throughput-Oriented NVMe Storage Virtualization With Workload-Aware Management
    Yang, Ming
    Peng, Bo
    Yao, Jianguo
    Guan, Haibing
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2021, 70 (12) : 2112 - 2124
  • [8] Improving MLC Flash Performance with Workload-Aware Differentiated ECC
    Xia, Qianbin
    Xiao, Weijun
    [J]. 2016 IEEE 22ND INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS), 2016, : 545 - 552
  • [9] Workload-aware Power Management of Cluster Systems
    Liu, Zhuo
    Liang, Aihua
    Xiao, Limin
    Ruan, Li
    [J]. PROCEEDINGS OF THE NINTH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING AND SCIENCE (DCABES 2010), 2010, : 603 - 608
  • [10] Workload-Aware Cache Management of Bitmap Indices
    Kaeppel, Julia
    Sawin, Jason
    Chiu, David
    [J]. PROCEEDINGS OF THE IEEE/ACM 10TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING, APPLICATIONS AND TECHNOLOGIES, BDCAT 2023, 2023,