Multi-GPU Communication Schemes for Iterative Solvers: When CPUs are Not in Charge

被引:0
|
作者
Ismayilov, Ismayil [1 ]
Baydamirli, Javid [1 ]
Sagbili, Dogan [1 ]
Wahib, Mohamed [2 ]
Unat, Didem [1 ]
机构
[1] Koç University, Istanbul, Turkey
[2] RIKEN Center for Computational Science, Kobe, Japan
基金
欧盟地平线“2020”; 欧洲研究理事会;
关键词
Engineering Village;
D O I
暂无
中图分类号
学科分类号
摘要
Communication schemes - Control-flow - Execution modeling - Flow path - GPU-initiated communication - Improve performance - Iterative solvers - Multi-GPU - NVSHMEM - Persistent kernel
引用
收藏
页码:192 / 202
相关论文
共 26 条
  • [21] Communication and Load Balancing Optimization for Finite Element Electromagnetic Simulations Using Multi-GPU Workstation
    Dziekonski, Adam
    Sypek, Piotr
    Lamecki, Adam
    Mrozowski, Michal
    IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2017, 65 (08) : 2661 - 2671
  • [22] Employing a Novel Consensus Optimization Strategy to Achieve Iterative Cone Beam CT Reconstruction On a Multi-GPU Platform
    Li, B.
    Tian, Z.
    Zhou, L.
    Jiang, S.
    Jia, X.
    MEDICAL PHYSICS, 2016, 43 (06) : 3344 - 3345
  • [23] Empirical Performance Evaluation of Communication Libraries for Multi-GPU based Distributed Deep Learning in a Container Environment
    Choi, HyeonSeong
    Kim, Youngrang
    Lee, Jaehwan
    Kim, Yoonhee
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2021, 15 (03): : 911 - 931
  • [24] Reducing Communication Overhead in Multi-GPU Hybrid Solver for 2D Laplace's Equation
    Czapinski, Michal
    Thompson, Chris
    Barnes, Stuart
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2014, 42 (06) : 1032 - 1047
  • [25] Reducing Communication Overhead in Multi-GPU Hybrid Solver for 2D Laplace’s Equation
    Michał Czapiński
    Chris Thompson
    Stuart Barnes
    International Journal of Parallel Programming, 2014, 42 : 1032 - 1047
  • [26] MGG: Accelerating Graph Neural Networks with Fine-Grained Intra-Kernel Communication-Computation Pipelining on Multi-GPU Platforms
    Wang, Yuke
    Feng, Boyuan
    Wang, Zheng
    Geng, Tong
    Barker, Kevin
    Li, Ang
    Ding, Yufei
    PROCEEDINGS OF THE 17TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, OSDI 2023, 2023, : 779 - 795