Maximizing I/O Throughput and Minimizing Performance Variation via Reinforcement Learning Based I/O Merging for SSDs

被引:16
|
作者
Wu, Chao [1 ]
Ji, Cheng [2 ]
Li, Qiao [1 ]
Gao, Congming [3 ,4 ]
Pan, Riwei [1 ]
Fu, Chenchen [5 ]
Shi, Liang [6 ]
Xue, Chun Jason [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Alnnovat Technol Ltd, Guangzhou, Peoples R China
[5] Southeast Univ China, Sch Comp Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
[6] East China Normal Univ, Coll Comp Sci, Shanghai 200062, Peoples R China
关键词
Merging; Throughput; Quality of service; Reinforcement learning; Mathematical model; Time factors; Performance evaluation; Merging technique; I; O scheduler; reinforcement learning; throughput; performance variation; worst-case latency; MANAGEMENT;
D O I
10.1109/TC.2019.2938956
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Merging technique is widely adopted by I/O schedulers to maximize system I/O throughput. However, I/O merging could increase the latency of individual I/O, thus incurring prolonged I/O latencies and enlarged performance variations. Even with better system throughput, higher worst-case latency experienced by some requests could block the SSD storage system, which violates the QoS (Quality of Service) requirement. In order to improve QoS performance while providing higher I/O throughput, this paper proposes a reinforcement learning based I/O merging approach. Through learning the characteristic of various I/O patterns, the proposed approach makes merging decisions adaptively based on different I/O workloads. Evaluation results show that the proposed scheme is capable of reducing the standard deviation of I/O latency by 19.1 percent on average, worst-case latency by 7.3-60.9 percent at the 99.9th percentile compared with the latest I/O merging scheme, while maximizing system throughput.
引用
收藏
页码:72 / 86
页数:15
相关论文
共 50 条
  • [21] Early Experience with Optimizing I/O Performance Using High-Performance SSDs for In-Memory Cluster Computing
    Choi, I. Stephen
    Yang, Weiqing
    Kee, Yang-Suk
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1073 - 1083
  • [22] Adaptive request scheduling for the I/O forwarding layer using reinforcement learning
    Bez, Jean Luca
    Boito, Francieli Zanon
    Nou, Ramon
    Miranda, Alberto
    Cortes, Toni
    Navaux, Philippe O. A.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 112 : 1156 - 1169
  • [23] Understanding the I/O Impact on the Performance of High-Throughput Molecular Docking
    Markidis, Stefano
    Gadioli, Davide
    Vitali, Emanuele
    Palermo, Gianluca
    PROCEEDINGS OF IEEE/ACM SIXTH INTERNATIONAL PARALLEL DATA SYSTEMS WORKSHOP (PDSW 2021), 2021, : 9 - 14
  • [24] Improving SAS® performance by improving I O throughput of SAS® work directory
    Xu, L
    PROCEEDINGS OF THE TWENTY-THIRD ANNUAL SAS USERS GROUP INTERNATIONAL CONFERENCE, 1998, : 1411 - 1415
  • [25] I/O Characterization and Performance Evaluation of BeeGFS for Deep Learning
    Chowdhury, Fahim
    Zhu, Yue
    Heer, Todd
    Paredes, Saul
    Moody, Adam
    Goldstone, Robin
    Mohror, Kathryn
    Yu, Weikuan
    PROCEEDINGS OF THE 48TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP 2019), 2019,
  • [26] High Performance I/O For Large Scale Deep Learning
    Aizman, Alex
    Maltby, Gavin
    Breuel, Thomas
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 5965 - 5967
  • [27] Active Learning-based Automatic Tuning and Prediction of Parallel I/O Performance
    Agarwal, Megha
    Singhvi, Divyansh
    Malakar, Preeti
    Byna, Suren
    PROCEEDINGS OF PDSW 2019: 2019 IEEE/ACM FOURTH INTERNATIONAL PARALLEL DATA SYSTEMS WORKSHOP (PDSW), 2019, : 20 - 29
  • [28] FIOS: Feature Based I/O Stream Identification for Improving Endurance of Multi-Stream SSDs
    Bhimani, Janki
    Mi, Ningfang
    Yang, Zhengyu
    Yang, Jingpei
    Pandurangan, Rajinikanth
    Choi, Changho
    Balakrishnan, Vijay
    PROCEEDINGS 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2018, : 17 - 24
  • [29] I/O Schedulers for Proportionality and Stability on Flash-Based SSDs in Multi-Tenant Environments
    Kim, Jaeho
    Lee, Eunjae
    Noh, Sam H.
    IEEE ACCESS, 2020, 8 : 4451 - 4465
  • [30] TOWARDS SCALABLE DEEP LEARNING VIA I/O ANALYSIS AND OPTIMIZATION
    Pumma, Sarunya
    Si, Min
    Feng, Wu-chun
    Balaji, Pavan
    2017 19TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS (HPCC) / 2017 15TH IEEE INTERNATIONAL CONFERENCE ON SMART CITY (SMARTCITY) / 2017 3RD IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS (DSS), 2017, : 223 - 230