Efficient Intranode Communication in GPU-Accelerated Systems

被引:1
|
作者
Ji, Feng [1 ]
Aji, Ashwin M. [2 ]
Dinan, James [3 ]
Buntinas, Darius [3 ]
Balaji, Pavan [3 ]
Feng, Wu-chun [2 ]
Ma, Xiaosong [1 ,4 ]
机构
[1] North Carolina State Univ, Dept Comp Sci, Raleigh, NC 27695 USA
[2] Virginia Tech, Dept Comp Sci, Blacksburg, VA USA
[3] Argonne Natl Lab, Math & Comp Sci Div, Argonne, IL 60439 USA
[4] Oak Ridge Natl Lab, Div Math & Comp Sci, Oak Ridge, TN USA
基金
美国国家科学基金会;
关键词
IMPLEMENTATION;
D O I
10.1109/IPDPSW.2012.227
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Current implementations of MPI are unaware of accelerator memory (i.e., GPU device memory) and require programmers to explicitly move data between memory spaces. This approach is inefficient, especially for intranode communication where it can result in several extra copy operations. In this work, we integrate GPU-awareness into a popular MPI runtime system and develop techniques to significantly reduce the cost of intranode communication involving one or more GPUs. Experiment results show an up to 2x increase in bandwidth, resulting in an average of 4.3% improvement to the total execution time of a halo exchange benchmark.
引用
收藏
页码:1838 / 1847
页数:10
相关论文
共 50 条
  • [31] Grus: Enabling Latency SLOs for GPU-Accelerated NFV Systems
    Zheng, Zhilong
    Bi, Jun
    Wang, Haiping
    Sun, Chen
    Yu, Heng
    Hu, Hongxin
    Gao, Kai
    Wu, Jianping
    2018 IEEE 26TH INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS (ICNP), 2018, : 154 - 164
  • [32] Efficient Wind Speed Nowcasting with GPU-Accelerated Nearest Neighbors Algorithm
    Pannatier, Arnaud
    Picatoste, Ricardo
    Fleuret, Francois
    PROCEEDINGS OF THE 2022 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2022, : 325 - 333
  • [33] pmemdGT: An efficient and accurate GPU-accelerated thermodynamics integration simulation package
    Lee, Tai-Sung
    York, Darrin
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2017, 253
  • [34] Efficient urban flood simulation using a GPU-accelerated SPH model
    Qiuhua Liang
    Xilin Xia
    Jingming Hou
    Environmental Earth Sciences, 2015, 74 : 7285 - 7294
  • [35] Efficient GPU-accelerated molecular dynamics simulation of solid covalent crystals
    Hou, Chaofeng
    Xu, Ji
    Wang, Peng
    Huang, Wenlai
    Wang, Xiaowei
    COMPUTER PHYSICS COMMUNICATIONS, 2013, 184 (05) : 1364 - 1371
  • [36] Efficient urban flood simulation using a GPU-accelerated SPH model
    Liang, Qiuhua
    Xia, Xilin
    Hou, Jingming
    ENVIRONMENTAL EARTH SCIENCES, 2015, 74 (11) : 7285 - 7294
  • [37] GPU-Accelerated and Efficient Multi-View Triangulation for Scene Reconstruction
    Mak, Jason
    Hess-Flores, Mauricio
    Recker, Shawn
    Owens, John D.
    Joy, Kenneth I.
    2014 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2014, : 61 - 68
  • [38] GPU-Accelerated Dynamic Graph Coloring
    Yang, Ying
    Gu, Yu
    Li, Chuanwen
    Wan, Changyi
    Yu, Ge
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, 2019, 11448 : 296 - 299
  • [39] Toward GPU-accelerated Database Optimization
    Meister, Andreas
    Breß, Sebastian
    Saake, Gunter
    Datenbank-Spektrum, 2015, 15 (02) : 131 - 140
  • [40] GPU-Accelerated Static Timing Analysis
    Guo, Zizheng
    Huang, Tsung-Wei
    Lin, Yibo
    2020 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED-DESIGN (ICCAD), 2020,