Survey on In-Network Storage Systems

被引:0
|
作者
Wang Q. [1 ]
Li J. [1 ]
Shu J. [1 ]
机构
[1] Department of Computer Science and Technology, Tsinghua University, Beijing
基金
中国国家自然科学基金;
关键词
distributed storage; in-network storage systems; programmable switch; SmartNICs;
D O I
10.7544/issn1000-1239.202220865
中图分类号
学科分类号
摘要
Programmable network devices, represented by programmable switches and SmartNICs, are increasingly used in modern data centers to support the execution of customized data processing logic on network data transmission paths, which brings new opportunities for building high-performance in-network storage systems. However, programmable network devices have hardware resource limitations (e.g., limited expressive powers and small memory space), and there are still many challenges to fully utilize their advantages and maximize the acceleration of storage systems. We systematically review the recent research progress of in-network storage systems. First, we describe the hardware architecture and performance characteristics of programmable network devices, and based on this, we summarize two major challenges in building high-performance in-network storage systems: 1) division of labor between hardware and software, 2) fault tolerance of the storage systems. Then, according to the tasks performed by programmable network devices (data caching, distributed coordination, request scheduling, data aggregation), we classify and describe existing in-network storage systems. Moreover, using several examples of in-network storage systems, we analyze corresponding design difficulties and software technologies. Finally, we indicate open problems that need to be explored in further research on in-network storage systems, including switch-NIC collaboration, data security, multi-tenancy, and automatic function offloading. © 2023 Science Press. All rights reserved.
引用
收藏
页码:2681 / 2695
页数:14
相关论文
共 53 条
  • [1] The digitization of the world: From edge to core
  • [2] ConnectX-6
  • [3] Bosshart P, Gibb G, Kim H S, Et al., Forwarding metamorphosis: Fast programmable match-action processing in hardware for SDN[J], ACM SIGCOMM Computer Communication Review, 43, 4, pp. 99-110, (2013)
  • [4] Intel Tofino intelligent fabric processors [EB/OL]
  • [5] NVIDIA BlueField data processing units [EB/OL]
  • [6] ConnectX SmartNICs
  • [7] Innova-2 Flex
  • [8] Xiaoxiao Ma, Fan Yang, Zhan Wang, Et al., Survey on smart network interface card[J], Journal of Computer Research and Development, 59, 1, (2022)
  • [9] Wang Qing, Lu Youyou, Xu Erci, Et al., Concordia: Distributed shared memory with in-network cache coherence[C], Proc of the 19th USENIX Conf on File and Storage Technologies, pp. 277-292, (2021)
  • [10] Chole S, Fingerhut A, Ma Sha, Et al., dRMT: Disaggregated programmable switching, Proc of the ACM Special Interest Group on Data Communication, (2017)