DFI: The Data Flow Interface for High-Speed Networks

被引：0

作者：

Thostrup, Lasse ^{[1
]}

Skrzypczak, Jan ^{[2
]}

Jasny, Matthias ^{[1
]}

Ziegler, Tobias ^{[1
]}

Binnig, Carsten ^{[1
]}

机构：

[1] Tech Univ Darmstadt, Darmstadt, Germany

[2] Zuse Inst, Berlin, Germany

来源：

SIGMOD '21: PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA | 2021年

关键词：

PERFORMANCE; RDMA; MANAGEMENT; END;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper, we propose the Data Flow Interface (DFI) as a way to make it easier for data processing systems to exploit high-speed networks without the need to deal with the complexity of RDMA. By lifting the level of abstraction, DFI factors out much of the complexity of network communication and makes it easier for developers to declaratively express how data should be efficiently routed to accomplish a given distributed data processing task. As we show in our experiments, DFI is able to support a wide variety of data-centric applications with high performance at a low complexity for the applications.

引用

页码：1825 / 1837

页数：13

共 50 条

[21] High-Speed Query Processing over High-Speed Networks
Roediger, Wolf
Muehlbauer, Tobias
Kemper, Alfons
Neumann, Thomas
PROCEEDINGS OF THE VLDB ENDOWMENT, 2015, 9 (04): : 228 - 239
[22] Lossless data compression programmable hardware for high-speed data networks
Núñez, JL
Jones, S
2002 IEEE INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT), PROCEEDINGS, 2002, : 290 - 293
[23] A SYSTEMATIC-APPROACH TO HOST INTERFACE DESIGN FOR HIGH-SPEED NETWORKS
STEENKISTE, PA
COMPUTER, 1994, 27 (03) : 47 - 57
[24] SELF-OPTIMIZING WINDOW FLOW-CONTROL IN HIGH-SPEED DATA-NETWORKS
LIAO, KQ
MASON, L
COMPUTER COMMUNICATIONS, 1993, 16 (11) : 706 - 716
[25] End-to-End Data-Flow Parallelism for Throughput Optimization in High-Speed Networks
Yildirim, Esma
Kosar, Tevfik
JOURNAL OF GRID COMPUTING, 2012, 10 (03) : 395 - 418
[26] End-to-End Data-Flow Parallelism for Throughput Optimization in High-Speed Networks
Esma Yildirim
Tevfik Kosar
Journal of Grid Computing, 2012, 10 : 395 - 418
[27] Netostat: analyzing dynamic flow patterns in high-speed networks
Murugesan, Sugeerth
Kiran, Mariam
Hamann, Bernd
Weber, Gunther H.
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (04): : 2915 - 2930
[28] Netostat: analyzing dynamic flow patterns in high-speed networks
Sugeerth Murugesan
Mariam Kiran
Bernd Hamann
Gunther H. Weber
Cluster Computing, 2022, 25 : 2915 - 2930
[29] Flow control in high-speed ATM wide area networks
Zhou, PF
Yang, OWW
UNIVERSITY AND INDUSTRY - PARTNERS IN SUCCESS, CONFERENCE PROCEEDINGS VOLS 1-2, 1998, : 249 - 252
[30] An Efficient Flow Label Collector Design for High-Speed Networks
Zhang, Boyu
Sun, Yu-E
Du, Yang
Huang, He
Gao, Guoju
Xu, Shenghui
IEEE COMMUNICATIONS LETTERS, 2021, 25 (07) : 2211 - 2215

← 1 2 3 4 5 →