DFI: The Data Flow Interface for High-Speed Networks

被引:0
|
作者
Thostrup, Lasse [1 ]
Skrzypczak, Jan [2 ]
Jasny, Matthias [1 ]
Ziegler, Tobias [1 ]
Binnig, Carsten [1 ]
机构
[1] Tech Univ Darmstadt, Darmstadt, Germany
[2] Zuse Inst, Berlin, Germany
关键词
PERFORMANCE; RDMA; MANAGEMENT; END;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose the Data Flow Interface (DFI) as a way to make it easier for data processing systems to exploit high-speed networks without the need to deal with the complexity of RDMA. By lifting the level of abstraction, DFI factors out much of the complexity of network communication and makes it easier for developers to declaratively express how data should be efficiently routed to accomplish a given distributed data processing task. As we show in our experiments, DFI is able to support a wide variety of data-centric applications with high performance at a low complexity for the applications.
引用
收藏
页码:1825 / 1837
页数:13
相关论文
共 50 条
  • [41] DATA SERVICES AND HIGH-SPEED INTERCONNECTION OF LOCAL AREA NETWORKS
    GASTAUD, G
    LAPIERRE, M
    RIX, P
    COMMUTATION & TRANSMISSION, 1990, 12 (03): : 29 - 42
  • [42] Dimensioning bandwidth for elastic traffic in high-speed data networks
    Berger, AW
    Kogan, Y
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2000, 8 (05) : 643 - 654
  • [43] System implications of heat in wireless high-speed data networks
    McCune, E
    RAWCON2000: 2000 IEEE RADIO AND WIRELESS CONFERENCE, PROCEEDINGS, 2000, : 265 - 265
  • [44] An FPGA-based interface for recording high-speed data stream
    Sun, ZY
    Dong, YG
    Guo, WX
    Xiong, JP
    Ma, C
    Jia, HB
    Feng, GP
    2002 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS AND WEST SINO EXPOSITION PROCEEDINGS, VOLS 1-4, 2002, : 1466 - 1470
  • [45] A new I/O interface architecture for high-speed data communication
    Gan, Q
    Ammar, R
    Abdallah, M
    IEEE INTERNATIONAL SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS, PROCEEDINGS, 1999, : 216 - 225
  • [46] Implementation of High-Speed USB Interface in Data Acquisition System for KTX
    Lv, Wengui
    Song, Kezhu
    Yang, Junfeng
    Cao, Ping
    Dong, Lei
    2012 18TH IEEE-NPSS REAL TIME CONFERENCE (RT), 2012,
  • [47] Design of High-Speed Parallel Data Interface Based on ARM & FPGA
    Zhang, Daode
    Pan, Yurong
    Hu, Xinyu
    JOURNAL OF COMPUTERS, 2012, 7 (03) : 804 - 809
  • [48] The communication protocol and interface design of a high-speed data acquisition system
    Li, YE
    Qiao, J
    Qin, JY
    ISTM/2003: 5TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-6, CONFERENCE PROCEEDINGS, 2003, : 437 - 439
  • [49] DESIGNING HIGH-SPEED CONTROLLERS FOR HIGH-SPEED LOCAL AREA NETWORKS
    MARTINI, P
    RUPPRECHT, M
    DALLAS GLOBECOM 89, VOLS 1-3: COMMUNICATIONS TECHNOLOGY FOR THE 1990S AND BEYOND, 1989, : 170 - 174
  • [50] NEUROCOMPUTING IN HIGH-SPEED NETWORKS
    HABIB, IW
    IEEE COMMUNICATIONS MAGAZINE, 1995, 33 (10) : 38 - &