Evaluating High Performance Data Transfer with RDMA-based Protocols in Wide-Area Networks

被引:5
|
作者
Kissel, Ezra [1 ]
Swany, Martin [2 ]
机构
[1] Univ Delaware, Sch Comp & Informat Sci, Newark, DE 19716 USA
[2] Indiana Univ, Sch Informat & Comp, Bloomington 47405, IL USA
关键词
D O I
10.1109/HPCC.2012.113
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The use of zero-copy RDMA is a promising area of development in support of high-performance data movement over wide-area networks. In particular, the emerging RDMA over Converged Ethernet (RoCE) standard enables the InfiniBand transport for use over existing and widely deployed network infrastructure. In this paper, we evaluate the use of RDMA over Ethernet in two deployment scenarios: 1) a gateway approach that adapts standard application connections to an RDMA-based protocol for transmission over wide-area network paths, and 2) the integration of our RDMA implementation into GridFTP, a popular data transfer tool for distributed computing. We evaluate both approaches over a number of wide-area network conditions emulated using a commercial network emulation device, and we analyze the overhead of our RDMA implementations from a systems perspective. Our results show a significant increase in network utilization and performance when using RDMA over high-latency paths with a reduced CPU and memory I/O footprint on our gateways and end host applications.
引用
收藏
页码:802 / 811
页数:10
相关论文
共 50 条
  • [31] SAN Optimization for High Performance Storage with RDMA Data Transfer
    Choi, Jae Woo
    Yu, Young Jin
    Eom, Hyeonsang
    Yeom, Heon Young
    Shin, Dong In
    2012 SC COMPANION: HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SCC), 2012, : 24 - 29
  • [32] Building a Wide-Area File Transfer Performance Predictor: An Empirical Study
    Liu, Zhengchun
    Kettimuthu, Rajkumar
    Balaprakash, Prasanna
    Rao, Nageswara S. V.
    Foster, Ian
    MACHINE LEARNING FOR NETWORKING, 2019, 11407 : 56 - 78
  • [33] SCTP-based middleware for MPI in wide-area networks
    Kamal, H
    Penoff, B
    Wagner, A
    PROCEEDINGS OF THE 3RD ANNUAL COMMUNICATION NETWORKS AND SERVICES RESEARCH CONFERENCE, 2005, : 157 - 162
  • [34] UDT: UDP-based data transfer for high-speed wide area networks
    Gu, Yunhong
    Grossman, Robert L.
    COMPUTER NETWORKS, 2007, 51 (07) : 1777 - 1799
  • [35] Ubiquitous access to wide-area high-performance computing
    Burchert, F
    Gatzka, S
    Hochberger, C
    Lee, CK
    Lucke, U
    Tavangarian, D
    TRENDS IN NETWORK AND PERVASIVE COMPUTING - ARCS 2002, 2002, 2299 : 209 - 223
  • [36] Measurement approaches to evaluate performance optimizations for wide-area wireless networks
    Chakravorty, R
    Chesterfield, J
    Rodriguez, P
    Banerjee, S
    PASSIVE AND ACTIVE NETWORK MEASUREMENT, 2004, 3015 : 257 - 266
  • [37] Enabling network-centric music performance in wide-area networks
    Kurtisi, Zefir
    Gu, Xiaoyuan
    Wolf, Lars
    COMMUNICATIONS OF THE ACM, 2006, 49 (11) : 52 - 54
  • [38] Wide-area high-performance computing using workstations
    Tavangarian, D
    Eschholz, P
    Koch, M
    Preuss, S
    24TH EUROMICRO CONFERENCE - PROCEEDING, VOLS 1 AND 2, 1998, : 945 - 952
  • [39] On the performance of reliable transport protocols over wide area networks
    Llahanas, A
    Vardalis, D
    Tsaoussidis, V
    IC'2000: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTERNET COMPUTING, 2000, : 443 - 449
  • [40] Explaining Wide Area Data Transfer Performance
    Liu, Zhengchun
    Balaprakash, Prasanna
    Kettimuthu, Rajkumar
    Foster, Ian
    HPDC'17: PROCEEDINGS OF THE 26TH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE PARALLEL AND DISTRIBUTED COMPUTING, 2017, : 167 - 178