Performance evaluation of main-memory hash joins on KNL

被引:0
|
作者
Tang, Deyou [1 ]
Zhang, Yazhuo [1 ]
Zeng, Qingmiao [1 ]
Chen, Hu [1 ]
机构
[1] South China Univ Technol, Univ Town Campus,382 Zhonghuan Rd East, Guangzhou, Peoples R China
关键词
performance evaluation; main-memory; hash join; algorithm; knights landing processor; KNL; memory latency; bandwidth; cache alignment; cache miss; prefetching; multi-channel dynamic random access memory; MCDRAM; MULTI-CORE;
D O I
10.1504/IJCSE.2019.104443
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
New hardware features have propelled designs and analysis in main-memory hash joins. In previous studies, memory access has always been the primary bottleneck for hash join algorithms. However, there are relatively few studies devoted to bottlenecks analysis on knights landing processor (KNL). In this paper, we pay attention to the state-of-the-art hash join algorithms on KNL and analyse their bottlenecks under different workloads. The analysis and comparisons in the paper show that both memory latency and bandwidth are keys to improve hash joins, and multi-channel dynamic random access memory (MCDRAM) reasonably plays a vital role in enhancing performance. Notably, we find that hash join algorithms that are hardware-oblivious perform better than hardware-conscious approaches. A typical algorithm of hardware-oblivious joins achieves a better performance than ever before to the best of our knowledge. Through the analysis, we shed light on how new features of KNL affect the performance of hash joins.
引用
收藏
页码:425 / 438
页数:14
相关论文
共 50 条
  • [41] A Chunk-Based Hash Table Caching Method for In-Memory Hash Joins
    Wei, Xing
    Hu, Huiqi
    Zhou, Xuan
    Zhou, Aoying
    [J]. WEB INFORMATION SYSTEMS ENGINEERING, WISE 2020, PT II, 2020, 12343 : 376 - 389
  • [42] A Data Distribution Strategy for Scalable Main-Memory Database
    Huang, Yunkui
    Zhang, YanSong
    Ji, XiaoDong
    Wang, ZhanWei
    Wang, Shan
    [J]. ADVANCES IN WEB AND NETWORK TECHNOLOGIES, AND INFORMATION MANAGEMENT, 2009, 5731 : 13 - 24
  • [43] Identifying Hot and Cold Data in Main-Memory Databases
    Levandoski, Justin J.
    Larson, Per-Ake
    Stoica, Radu
    [J]. 2013 IEEE 29TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2013, : 26 - 37
  • [44] New DRAMs aim to ease main-memory bottlenecks
    Bondurant, D
    [J]. ELECTRONIC PRODUCTS MAGAZINE, 1997, 39 (12): : 63 - 66
  • [45] Opportunities for optimism in contended main-memory multicore transactions
    Huang, Yihe
    Qian, William
    Kohler, Eddie
    Liskov, Barbara
    Shrira, Liuba
    [J]. VLDB JOURNAL, 2022, 31 (06): : 1239 - 1261
  • [46] Relaxed AVL trees, main-memory databases and concurrency
    Nurmi, O
    SoisalonSoininen, E
    Wood, D
    [J]. INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 1996, 62 (1-2) : 23 - 44
  • [47] On Main-memory Flushing in Microblogs Data Management Systems
    Magdy, Amr
    Alghamdi, Rami
    Mokbel, Mohamed F.
    [J]. 2016 32ND IEEE INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2016, : 445 - 456
  • [48] Fast Failure Recovery for Main-Memory DBMSs on Multicores
    Wu, Yingjun
    Guo, Wentian
    Chan, Chee-Yong
    Tan, Kian-Lee
    [J]. SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, : 267 - 281
  • [49] Main-Memory Scan Sharing For Multi-Core CPUs
    Qiao, Lin
    Raman, Vijayshankar
    Reiss, Frederick
    Haas, Peter J.
    Lohman, Guy M.
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2008, 1 (01): : 610 - 621
  • [50] Performance comparison of pipelined hash joins on workstation clusters
    Imasaki, K
    Nguyen, H
    Dandamudi, SP
    [J]. HIGH PERFORMANCE COMPUTING - HIPC 2002, PROCEEDINGS, 2002, 2552 : 264 - 275