DFI: The Data Flow Interface for High-Speed Networks

被引:0
|
作者
Thostrup, Lasse [1 ]
Skrzypczak, Jan [2 ]
Jasny, Matthias [1 ]
Ziegler, Tobias [1 ]
Binnig, Carsten [1 ]
机构
[1] Tech Univ Darmstadt, Darmstadt, Germany
[2] Zuse Inst, Berlin, Germany
关键词
PERFORMANCE; RDMA; MANAGEMENT; END;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose the Data Flow Interface (DFI) as a way to make it easier for data processing systems to exploit high-speed networks without the need to deal with the complexity of RDMA. By lifting the level of abstraction, DFI factors out much of the complexity of network communication and makes it easier for developers to declaratively express how data should be efficiently routed to accomplish a given distributed data processing task. As we show in our experiments, DFI is able to support a wide variety of data-centric applications with high performance at a low complexity for the applications.
引用
收藏
页码:1825 / 1837
页数:13
相关论文
共 50 条
  • [1] DFI: The Data Flow Interface for High-Speed Networks
    Thostrup, Lasse
    Skrzypczak, Jan
    Jasny, Matthias
    Ziegler, Tobias
    Binnig, Carsten
    SIGMOD RECORD, 2022, 51 (01) : 15 - 22
  • [2] Technical perspective: DFI: The Data Flow Interface for High-Speed Networks
    Alonso, Gustavo
    SIGMOD RECORD, 2022, 51 (01) : 14 - 14
  • [3] A HOST INTERFACE ARCHITECTURE FOR HIGH-SPEED NETWORKS
    STEENKISTE, PA
    ZILL, BD
    KUNG, HT
    SCHLICK, SJ
    HUGHES, J
    KOWALSKI, B
    MULLANEY, J
    HIGH PERFORMANCE NETWORKING, IV, 1993, 14 : 31 - 46
  • [4] VCSELs for High-Speed Data Networks
    Murty, M. V. Ramana
    Giovane, L.
    Ray, S. K.
    Chew, K. -L.
    Crom, M. V.
    Sale, T. E.
    Sridhara, A.
    Zhao, C.
    Chen, Chu
    Fanning, T. R.
    VERTICAL-CAVITY SURFACE-EMITTING LASERS XVII, 2013, 8639
  • [5] Decentralized adaptive flow control of high-speed connectionless data networks
    Vázquez-Abad, FJ
    Mason, LG
    OPERATIONS RESEARCH, 1999, 47 (06) : 928 - 942
  • [6] A USB Interface High-speed Data Acquisition System
    Cui Wei
    Chen Lei
    Li Xingguang
    MECHANICAL AND ELECTRONICS ENGINEERING III, PTS 1-5, 2012, 130-134 : 2170 - 2173
  • [7] Timeout Strategy of Sampled Flow in High-Speed Networks
    Ye, Hong
    Liu, Shanshan
    Liu, Weijiang
    Li, Shuyun
    PROCEEDINGS 2013 INTERNATIONAL CONFERENCE ON MECHATRONIC SCIENCES, ELECTRIC ENGINEERING AND COMPUTER (MEC), 2013, : 2061 - 2065
  • [8] Timeout strategy of sampled flow in high-speed networks
    Ye, Hong
    Liu, Shanshan
    Liu, Weijiang
    Li, Shuyun
    Proceedings - 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer, MEC 2013, 2013, : 2061 - 2065
  • [9] Fast flow control in high-speed communications networks
    Kwan, C
    Xu, R
    Haynes, L
    Chou, CH
    Geraniotis, E
    PROCEEDINGS OF THE 37TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1998, : 2139 - 2140
  • [10] Architectures and technologies for high-speed optical data networks
    Chan, VWS
    Hall, KL
    Modiano, E
    Rauschenbach, KA
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 1998, 16 (12) : 2146 - 2168