An Adaptive, Scalable, and Portable Technique for Speeding Up MPI-Based Applications

被引:0
|
作者
Filgueira, Rosa [1 ]
Atkinson, Malcolm [1 ]
Nunez, Alberto [2 ]
Fernandez, Javier [3 ]
机构
[1] Univ Edinburgh, Sch Informat, Edinburgh EH8 9AB, Midlothian, Scotland
[2] Univ Complutense Madrid, Dept Sistemas Informat Computac, Madrid 28040, Spain
[3] Univ Carlos III Madrid, Dept Arquitectura Comp, Leganes 3028911, Spain
来源
关键词
MPI Library; Parallel techniques; High-Performance Computing; Compression algorithms; Adaptive systems; Portable optimizations; FLOATING-POINT DATA; COMPRESSION; PERFORMANCE; IMPLEMENTATION;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper presents a portable optimization for MPI communications, called PRAcTICaL-MPI (Portable Adaptive Compression Library- MPI). PRAcTICaL-MPI reduces the data volume exchanged among processes by using lossless compression and offers two main advantages. Firstly, it is independent of the MPI implementation and the application used. Secondly, it allows for turning the compression on and off and selecting the most appropriate compression algorithm at runtime, depending on the characteristics of each message and on network performance. We have validated PRAcTICaL-MPI in different MPI implementations and HPC clusters. The evaluation shows that compressing MPI messages with the best algorithm and only when it is worthwhile, we obtain a great reduction in the overall execution time for many of the scenarios considered.
引用
收藏
页码:729 / 740
页数:12
相关论文
共 50 条
  • [21] The Removal of ocular artifacts from EEG Signals: an Adaptive Modeling technique for Portable Applications
    Li, Yang
    Hu, Bin
    Zhao, Qinglin
    Peng, Hong
    Shi, Yujun
    Li, Yunpeng
    Moore, Philip
    2013 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2013,
  • [22] Speeding-up adaptive heuristic critic learning with FPGA-based unsupervised clustering
    PerezUribe, A
    Sanchez, E
    PROCEEDINGS OF 1997 IEEE INTERNATIONAL CONFERENCE ON EVOLUTIONARY COMPUTATION (ICEC '97), 1997, : 685 - 689
  • [23] Speeding up an Adaptive Filter based ECG Signal Pre-processing on Embedded Architectures
    Mejhoudi, Safa
    Latif, Rachid
    Saddik, Amine
    Jenkal, Wissam
    El Ouardi, Abdelhafid
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (05) : 361 - 369
  • [24] An Adaptive Hybrid and Cluster-Based Model for Speeding Up the k-NN Classifier
    Ougiaroglou, Stefanos
    Evangelidis, Georgios
    Dervos, Dimitris A.
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PT II, 2012, 7209 : 163 - 175
  • [25] Dynamic Gaussian selection technique for speeding up HMM-based continuous speech recognition
    Cai, Jun
    Bouselmi, Ghazi
    Fohr, Dominique
    Laprie, Yves
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 4461 - 4464
  • [26] ACURDION: An Adaptive Clustering-based Algorithm for Tracing Large-scale MPI Applications
    Bahmani, Amir
    Mueller, Frank
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 785 - 792
  • [27] Adaptive reference voltage-based MPPT technique for PV applications
    Lasheen, Mohamed
    Rahman, Ali Kamel Abdel
    Abdel-Salam, Mazen
    Ookawara, Shinichi
    IET RENEWABLE POWER GENERATION, 2017, 11 (05) : 715 - 722
  • [28] Costing Analysis of Scalable Carbon-Based Perovskite Modules Using Bottom Up Technique
    Kajal, Priyanka
    Verma, Bhupesh
    Vadaga, Satya Gangadhara Rao
    Powar, Satvasheel
    GLOBAL CHALLENGES, 2022, 6 (02)
  • [29] A Geometric Estimation Technique Based on Adaptive M-Estimators: Algorithm and Applications
    Li, Jiayuan
    Hu, Qingwu
    Ai, Mingyao
    Wang, Shaohua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 5613 - 5626
  • [30] A spread spectrum based scalable blind digital watermarking technique for multi-purpose multimedia applications
    Ahmad, S
    Mirza, SM
    Qamar, S
    E-TECH 2004, 2004, : 10 - 16