Hybrid CUDA, OpenMP, and MPI parallel programming on multicore GPU clusters

被引：71
|
作者：
Yang, Chao-Tung [1 ]
Huang, Chih-Lin [1 ]
Lin, Cheng-Fang [1 ]
机构：
[1] Tunghai Univ, Dept Comp Sci, Taichung 40704, Taiwan
来源：
COMPUTER PHYSICS COMMUNICATIONS | 2011年 / 182卷 / 01期
关键词：
CUDA; GPU; MPI; OpenMP; Hybrid; Parallel programming;
D O I：
10.1016/j.cpc.2010.06.035
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
Nowadays NVIDIA s CUDA is a general purpose scalable parallel programming model for writing highly parallel applications It provides several key abstractions - a hierarchy of thread blocks shared memory and barrier synchronization This model has proven quite successful at programming multithreaded many core GPUs and scales transparently to hundreds of cores scientists throughout industry and academia are already using CUDA to achieve dramatic speedups on production and research codes In this paper we propose a parallel programming approach using hybrid CUDA OpenMP and MPI programming which partition loop iterations according to the number of C1060 CPU nodes in a CPU cluster which consists of one C1060 and one S1070 Loop iterations assigned to one MPI process are processed in parallel by CUDA run by the processor cores in the same computational node (C) 2010 Elsevier B V All rights reserved
引用
收藏
页码：266 / 269
页数：4
相关论文
共 50 条
  • [21] Gyrokinetic semi-lagrangian parallel simulation using a hybrid OpenMP/MPI programming
    Latu, G.
    Crouseilles, N.
    Grandgirard, V.
    Sonnendrucker, E.
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2007, 4757 : 356 - +
  • [22] A hybrid MPI/OpenMP implementation of a parallel 3-D FFT on SMP clusters
    Takahashi, Daisuke
    [J]. PARALLEL PROCESSING AND APPLIED MATHEMATICS, 2006, 3911 : 970 - 977
  • [23] Parallel Multigrid Solvers Using OpenMP/MPI Hybrid Programming Models on Multi-Core/Multi-Socket Clusters
    Nakajima, Kengo
    [J]. HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2010, 2011, 6449 : 185 - 199
  • [24] Early experiments with the OpenMP/MPI hybrid programming model
    Lusk, Ewing
    Chan, Anthony
    [J]. OPENMP IN A NEW ERA OF PARALLELISM, PROCEEDINGS, 2008, 5004 : 36 - +
  • [25] Parallelization of Array Method with Hybrid Programming: OpenMP and MPI
    Velarde Martinez, Apolinar
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [26] An OpenMP Programming Toolkit for Hybrid CPU/GPU Clusters Based on Software Unified Memory
    Li, Hung-Fu
    Liang, Tyng-Yeu
    Lin, Yu-Jie
    [J]. JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2016, 32 (03) : 517 - 539
  • [27] Hybrid MPI/OpenMP Programming on the Tilera Manycore Architecture
    Chandru, Vishwanathan
    Mueller, Frank
    [J]. 2016 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS 2016), 2016, : 326 - 333
  • [28] Parallel hybrid particle simulations using MPI and OpenMP
    Hipp, M
    Rosenstiel, W
    [J]. EURO-PAR 2004 PARALLEL PROCESSING, PROCEEDINGS, 2004, 3149 : 189 - 197
  • [29] Hybrid Parallel Programming with MPI/StarSs
    Labarta, Jesus
    Marjanovic, Vladimir
    Ayguade, Eduard
    Badia, Rosa M.
    Valero, Mateo
    [J]. APPLICATIONS, TOOLS AND TECHNIQUES ON THE ROAD TO EXASCALE COMPUTING, 2012, 22 : 621 - 628
  • [30] High performance computing for flood simulation using Telemac based on hybrid MPI/OpenMP parallel programming
    Shang, Zhi
    [J]. INTERNATIONAL JOURNAL OF MODELING SIMULATION AND SCIENTIFIC COMPUTING, 2014, 5 (04)
12345