Maximizing I/O Throughput and Minimizing Performance Variation via Reinforcement Learning Based I/O Merging for SSDs

被引:16
|
作者
Wu, Chao [1 ]
Ji, Cheng [2 ]
Li, Qiao [1 ]
Gao, Congming [3 ,4 ]
Pan, Riwei [1 ]
Fu, Chenchen [5 ]
Shi, Liang [6 ]
Xue, Chun Jason [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[3] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[4] Alnnovat Technol Ltd, Guangzhou, Peoples R China
[5] Southeast Univ China, Sch Comp Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
[6] East China Normal Univ, Coll Comp Sci, Shanghai 200062, Peoples R China
关键词
Merging; Throughput; Quality of service; Reinforcement learning; Mathematical model; Time factors; Performance evaluation; Merging technique; I; O scheduler; reinforcement learning; throughput; performance variation; worst-case latency; MANAGEMENT;
D O I
10.1109/TC.2019.2938956
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Merging technique is widely adopted by I/O schedulers to maximize system I/O throughput. However, I/O merging could increase the latency of individual I/O, thus incurring prolonged I/O latencies and enlarged performance variations. Even with better system throughput, higher worst-case latency experienced by some requests could block the SSD storage system, which violates the QoS (Quality of Service) requirement. In order to improve QoS performance while providing higher I/O throughput, this paper proposes a reinforcement learning based I/O merging approach. Through learning the characteristic of various I/O patterns, the proposed approach makes merging decisions adaptively based on different I/O workloads. Evaluation results show that the proposed scheme is capable of reducing the standard deviation of I/O latency by 19.1 percent on average, worst-case latency by 7.3-60.9 percent at the 99.9th percentile compared with the latest I/O merging scheme, while maximizing system throughput.
引用
收藏
页码:72 / 86
页数:15
相关论文
共 50 条
  • [41] Using object based files for high performance parallel I/O
    Logan, Jeremy
    Dickens, Phillip M.
    IDAACS 2007: PROCEEDINGS OF THE 4TH IEEE WORKSHOP ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS, 2007, : 149 - +
  • [42] Performance assessment of MIMO systems based on I/O delay information
    Xia, H
    Majecki, P
    Ordys, A
    Grimble, M
    JOURNAL OF PROCESS CONTROL, 2006, 16 (04) : 373 - 383
  • [43] A new MultiAgent based architecture for high performance I/O in clusters
    Pérez, MS
    García, F
    Carretero, J
    INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING WORKSHOPS, PROCEEDINGS, 2001, : 201 - 206
  • [44] Learning-based page replacement scheme for efficient I/O processing
    Kim, Hwajung
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [45] Integration testing of distributed components based on learning parameterized I/O models
    Li, Keqin
    Groz, Roland
    Shahbaz, Muzammil
    FORMAL TECHNIQUES FOR NETWORKED AND DISTRIBUTED SYSTEMS - FORTE 2006, 2006, 4229 : 436 - 450
  • [46] PHDFS: Optimizing I/O performance of HDFS in deep learning cloud computing platform
    Zhu, Zongwei
    Tan, Luchao
    Li, Yinzhen
    Ji, Cheng
    JOURNAL OF SYSTEMS ARCHITECTURE, 2020, 109
  • [47] Improving Collective I/O Performance with Machine Learning Supported Auto-tuning
    Bagbaba, Ayse
    2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW 2020), 2020, : 814 - 821
  • [48] Alternatives to enhance the performance of disk I/O in ring-based multiprocessors
    Kim, CH
    Jhang, ST
    Jhon, CS
    PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-V, 2000, : 2227 - 2232
  • [49] Apply aggregate I/O to improve performance of network storage based on IP
    Cao, Q
    Xie, CS
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES, PROCEEDINGS, 2003, 2834 : 167 - 171
  • [50] Parallel I/O Characterisation Based on Server-Side Performance Counters
    El Sayed, Salem
    Bolten, Matthias
    Pleiter, Dirk
    Frings, Wolfgang
    PROCEEDINGS OF PDSW-DISCS 2016 - 1ST JOINT INTERNATIONAL WORKSHOP ON PARALLEL DATA STORAGE AND DATA INTENSIVE SCALABLE COMPUTING SYSTEMS, 2016, : 7 - 12