Maximizing I/O Throughput and Minimizing Performance Variation via Reinforcement Learning Based I/O Merging for SSDs

被引:16
|
作者
Wu, Chao [1 ]
Ji, Cheng [2 ]
Li, Qiao [1 ]
Gao, Congming [3 ,4 ]
Pan, Riwei [1 ]
Fu, Chenchen [5 ]
Shi, Liang [6 ]
Xue, Chun Jason [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Alnnovat Technol Ltd, Guangzhou, Peoples R China
[5] Southeast Univ China, Sch Comp Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
[6] East China Normal Univ, Coll Comp Sci, Shanghai 200062, Peoples R China
关键词
Merging; Throughput; Quality of service; Reinforcement learning; Mathematical model; Time factors; Performance evaluation; Merging technique; I; O scheduler; reinforcement learning; throughput; performance variation; worst-case latency; MANAGEMENT;
D O I
10.1109/TC.2019.2938956
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Merging technique is widely adopted by I/O schedulers to maximize system I/O throughput. However, I/O merging could increase the latency of individual I/O, thus incurring prolonged I/O latencies and enlarged performance variations. Even with better system throughput, higher worst-case latency experienced by some requests could block the SSD storage system, which violates the QoS (Quality of Service) requirement. In order to improve QoS performance while providing higher I/O throughput, this paper proposes a reinforcement learning based I/O merging approach. Through learning the characteristic of various I/O patterns, the proposed approach makes merging decisions adaptively based on different I/O workloads. Evaluation results show that the proposed scheme is capable of reducing the standard deviation of I/O latency by 19.1 percent on average, worst-case latency by 7.3-60.9 percent at the 99.9th percentile compared with the latest I/O merging scheme, while maximizing system throughput.
引用
收藏
页码:72 / 86
页数:15
相关论文
共 50 条
  • [31] Improving I/O Performance via Address Remapping in NVMe Interface
    Sung, Dong Kyu
    Son, Yongseok
    Eom, Hyeonsang
    Kim, Sunggon
    IEEE ACCESS, 2022, 10 : 119722 - 119733
  • [32] Optimizing HPC I/O Performance with Regression Analysis and Ensemble Learning
    Liu, Zhangyu
    Zhang, Cheng
    Wu, Huijun
    Fang, Jianbin
    Peng, Lin
    Ye, Guixin
    Tang, Zhanyong
    2023 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, CLUSTER, 2023, : 234 - 246
  • [33] Predicting Performance of Non-contiguous I/O with Machine Learning
    Kunkel, Julian
    Zimmer, Michaela
    Betke, Eugen
    HIGH PERFORMANCE COMPUTING, ISC HIGH PERFORMANCE 2015, 2015, 9137 : 257 - 273
  • [34] I/O path based performance model for storage systems
    Department of Precision Instruments and Mechanology, Tsinghua University, Beijing 100084, China
    Qinghua Daxue Xuebao, 2006, 11 (1824-1827):
  • [35] Methodology to quantify I/O performance based on analytical models
    Heger, DA
    ISAS/CITSA 2004: International Conference on Cybernetics and Information Technologies, Systems and Applications and 10th International Conference on Information Systems Analysis and Synthesis, Vol 1, Proceedings: COMMUNICATIONS, INFORMATION TECHNOLOGIES AND COMPUTING, 2004, : 363 - 375
  • [36] Better database cost/performance via batched I/O on programmable SSD
    Do, Jaeyoung
    Picoli, Ivan Luiz
    Lomet, David
    Bonnet, Philippe
    VLDB JOURNAL, 2021, 30 (03): : 403 - 424
  • [37] Exploring Virtual Machine Covert Channel via I/O Performance Interference
    Yang, Ziye
    Chen, Ping
    2013 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA (CLOUDCOM-ASIA), 2013, : 232 - 239
  • [38] Better database cost/performance via batched I/O on programmable SSD
    Jaeyoung Do
    Ivan Luiz Picoli
    David Lomet
    Philippe Bonnet
    The VLDB Journal, 2021, 30 : 403 - 424
  • [39] Investigating Machine Learning Algorithms for Modeling SSD I/O Performance for Container-Based Virtualization
    Dartois, Jean-Emile
    Boukhobza, Jalil
    Knefati, Anas
    Barais, Olivier
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (03) : 1103 - 1116
  • [40] I/O performance analysis of machine learning workloads on leadership scale supercomputer
    Karimi, Ahmad Maroof
    Paul, Arnab K.
    Wang, Feiyi
    PERFORMANCE EVALUATION, 2022, 157