Toward Millions of File System IOPS on Low-Cost, Commodity Hardware

被引：16
|
作者：
Zheng, Da [1 ]
Burns, Randal [1 ]
Szalay, Alexander S.
机构：
[1] Johns Hopkins Univ, Dept Comp Sci, Baltimore, MD 21218 USA
来源：
2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC) | 2013年
基金：
美国国家科学基金会;
关键词：
Data-intensive computing; page cache optimization; millions of IOPS; low cost; solid-state storage devices;
D O I：
10.1145/2503210.2503225
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
We describe a storage system that removes I/O bottlenecks to achieve more than one million TOPS based on a user-space file abstraction for arrays of commodity SSDs. The file abstraction refactors I/O scheduling and placement for extreme parallelism and non-uniform memory and I/O. The system includes a set-associative, parallel page cache in the user space. We redesign page caching to eliminate CPU overhead and lock-contention in non-uniform memory architecture machines. We evaluate our design on a 32 core NUMA machine with four, eight-core processors. Experiments show that our design delivers 1.23 million 512-byte read TOPS. The page cache realizes the scalable TOPS of Linux asynchronous I/O (AIO) and increases user-perceived I/O performance linearly with cache hit rates. The parallel, set-associative cache matches the cache hit rates of the global Linux page cache under real workloads.
引用
收藏
页数：12
相关论文
共 50 条
  • [41] Low-cost Software and Hardware Architecture of a Supervisory System for Monitoring and Control of Dynamic Systems
    Caballero, Franco D. B.
    Leston, Luciano A.
    de Lima, Sigmar
    Vahl, Bruno R.
    Penaloza, Elmer A. G.
    [J]. 2020 IEEE 14TH INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC 2020), 2020, : 321 - 325
  • [42] A Low-Cost MMSE-SIC Detector for the MIMO System: Algorithm and Hardware Implementation
    Liu, Tsung-Hsien
    Jiang, Jin-Yi
    Chu, Yuan-Sun
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2011, 58 (01) : 56 - 61
  • [43] High-speed Classification of AER Data Based on a Low-cost Hardware System
    Huang, Jinguo
    Lin, Yingcheng
    He, Wei
    Zhou, Xichuan
    Shi, Cong
    Wu, Nanjian
    Luo, Gang
    [J]. 2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2019,
  • [44] Low-cost and Real-time Hardware Implementation of Stereo Vision System on FPGA
    Fathi, Mostafa
    Sheikhaei, Samad
    Tavakoli, Javad
    [J]. 2019 27TH IRANIAN CONFERENCE ON ELECTRICAL ENGINEERING (ICEE 2019), 2019, : 258 - 263
  • [45] Low-cost hardware for a time-domain microwave system for breast health monitoring
    Santorelli, Adam
    Porter, Emily
    Dantas, Stefano
    Popovic, Milica
    Schwartz, Joshua
    [J]. 2016 10TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION (EUCAP), 2016,
  • [46] Construction of dPCR and qPCR integrated system based on commercially available low-cost hardware
    Wang, Kangning
    Sang, Benliang
    He, Limin
    Guo, Yu
    Geng, Mingkun
    Zheng, Dezhou
    Xu, Xiaolong
    Wu, Wenming
    [J]. ANALYST, 2022, 147 (15) : 3494 - 3503
  • [47] Low-cost, open-hardware shadow band system for diffuse irradiance measurements
    Quispe, G.
    Perez, J.
    Conde, L.
    Carhuavilca, A.
    Berastain, A.
    Garcia, M.
    Tofflinger, J. A.
    [J]. PERUVIAN WORKSHOP ON SOLAR ENERGY, JOPES 2022, 2023, 2538
  • [48] Low-cost, high-efficiency hardware implementation of smart traffic light system
    Thien Truong Nguyen-Ly
    Linh Tran
    Huynh, Thinh, V
    [J]. 2019 INTERNATIONAL SYMPOSIUM ON ELECTRICAL AND ELECTRONICS ENGINEERING (ISEE 2019), 2019, : 28 - 32
  • [49] Low-cost landing system
    Anon
    [J]. Design News (Boston), 2001, 56 (17):
  • [50] A low-cost teleradiology system
    Lin, TY
    Chen, SP
    Duan, HL
    Tao, DC
    Lu, WX
    [J]. IEEE-EMBS ASIA PACIFIC CONFERENCE ON BIOMEDICAL ENGINEERING - PROCEEDINGS, PTS 1 & 2, 2000, : 83 - 84
12345