A Distributed Hash Table for Shared Memory

被引：1

作者：

Oortwijn, Wytse ^{[1
]}

van Dijk, Tom ^{[1
]}

van de Pol, Jaco ^{[1
]}

机构：

[1] Univ Twente, Dept EEMCS, Formal Methods & Tools, POB 217, NL-7500 AE Enschede, Netherlands

来源：

PARALLEL PROCESSING AND APPLIED MATHEMATICS, PPAM 2015, PT II | 2016年 / 9574卷

关键词：

Distributed hash table; High-performance computing; Partitioned global address space; Remote direct memory access;

D O I：

10.1007/978-3-319-32152-3_2

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Distributed algorithms for graph searching require a high-performance CPU-efficient hash table that supports find-or-put. This operation either inserts data or indicates that it has already been added before. This paper focuses on the design and evaluation of such a hash table, targeting supercomputers. The latency of find-or-put is minimized by using one-sided RDMA operations. These operations are overlapped as much as possible to reduce waiting times for roundtrips. In contrast to existing work, we use linear probing and argue that this requires less roundtrips. The hash table is implemented in UPC. A peak-throughput of 114.9 million op/s is reached on an Infiniband cluster. With a load-factor of 0.9, find-or-put can be performed in 4.5 mu s on average. The hash table performance remains very high, even under high loads.

引用

页码：15 / 24

页数：10

共 50 条

[1] Performance of an Intuitive Hash Table in Shared-Memory Parallel Programs
Cischke, Christopher
[J]. HIGH PERFORMANCE COMPUTING SYMPOSIUM 2013 (HPC 2013) - 2013 SPRING SIMULATION MULTI-CONFERENCE (SPRINGSIM'13), 2013, 45 (06): : 10 - 14
[2] Improving Hash Distributed A* for Shared Memory Architectures Using Abstraction
Sanz, Victoria
De Giusti, Armando
Naiouf, Marcelo
[J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2016, 2016, 10048 : 431 - 439
[3] Social distributed hash table
Matuszewski, Marcin
Garcia-Martin, Miguel A.
[J]. 2007 IEEE WIRELESS COMMUNICATIONS & NETWORKING CONFERENCE, VOLS 1-9, 2007, : 2814 - 2820
[4] Towards Secure Distributed Hash Table
Wang, Zhe
Minsky, Naftaly H.
[J]. COLLABORATIVE COMPUTING: NETWORKING, APPLICATIONS, AND WORKSHARING, COLLABORATECOM 2015, 2016, 163 : 257 - 266
[5] Distributed Hash Table on mobile phones
Kelenyi, Imre
Forstner, Bertalan
[J]. 2008 5TH IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2008, : 1226 - 1227
[6] Distributed MapReduce Framework using Distributed Hash Table
Chiu, Chuan-Feng
Hsu, Steen J.
Jan, Sen-Ren
[J]. 2013 INTERNATIONAL JOINT CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY & UBI-MEDIA COMPUTING (ICAST-UMEDIA), 2013, : 475 - 480
[7] Fully Distributed Indexing over a Distributed Hash Table
Desaulniers, Simon
Beraud, Adrien
Masse, Alexandre Blondin
Reynaud, Nicolas
[J]. UBIQUITOUS NETWORKING, UNET 2017, 2017, 10542 : 308 - 318
[8] Latency model of a distributed hash table with big routing table
Kato, D
[J]. FOURTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING, PROCEEDINGS, 2004, : 274 - 275
[9] ReCord: A distributed hash table with recursive structure
Zeng, JY
Hsu, WJ
[J]. PDCAT 2005: SIXTH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PROCEEDINGS, 2005, : 16 - 20
[10] A simple fault tolerant distributed hash table
Naor, M
Wieder, U
[J]. PEER-TO-PEER SYSTEMS II, 2003, 2735 : 88 - 97

← 1 2 3 4 5 →