An Adaptive, Scalable, and Portable Technique for Speeding Up MPI-Based Applications

被引：0

作者：

Filgueira, Rosa ^{[1
]}

Atkinson, Malcolm ^{[1
]}

Nunez, Alberto ^{[2
]}

Fernandez, Javier ^{[3
]}

机构：

[1] Univ Edinburgh, Sch Informat, Edinburgh EH8 9AB, Midlothian, Scotland

[2] Univ Complutense Madrid, Dept Sistemas Informat Computac, Madrid 28040, Spain

[3] Univ Carlos III Madrid, Dept Arquitectura Comp, Leganes 3028911, Spain

来源：

EURO-PAR 2012 PARALLEL PROCESSING | 2012年 / 7484卷

关键词：

MPI Library; Parallel techniques; High-Performance Computing; Compression algorithms; Adaptive systems; Portable optimizations; FLOATING-POINT DATA; COMPRESSION; PERFORMANCE; IMPLEMENTATION;

D O I：

暂无

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

This paper presents a portable optimization for MPI communications, called PRAcTICaL-MPI (Portable Adaptive Compression Library- MPI). PRAcTICaL-MPI reduces the data volume exchanged among processes by using lossless compression and offers two main advantages. Firstly, it is independent of the MPI implementation and the application used. Secondly, it allows for turning the compression on and off and selecting the most appropriate compression algorithm at runtime, depending on the characteristics of each message and on network performance. We have validated PRAcTICaL-MPI in different MPI implementations and HPC clusters. The evaluation shows that compressing MPI messages with the best algorithm and only when it is worthwhile, we obtain a great reduction in the overall execution time for many of the scenarios considered.

引用

页码：729 / 740

页数：12

共 50 条

[31] Speeding Up Non-Parametric Bootstrap Computations for Statistics Based on Sample Moments in Small/Moderate Sample Size Applications
Neto, Elias Chaibub
PLOS ONE, 2015, 10 (06):
[32] Window-based adaptive technique for real-time streaming of scalable video over cognitive radio networks
Omer, Ala Eldin
Hassan, Mohamed S.
El-Tarhuni, Mohamed
IET COMMUNICATIONS, 2017, 11 (17) : 2643 - 2649
[33] PPG Noise Reduction based on Adaptive Frequency Suppression using Discrete Fourier Transform for Portable Home Monitoring Applications
Sadhukhan, Deboleena
Pal, Saurabh
Mitra, Madhuchhanda
IEEE INDICON: 15TH IEEE INDIA COUNCIL INTERNATIONAL CONFERENCE, 2018,
[34] Applications of scale-adaptive simulation technique based on one-equation turbulence model
Chang-yue XU
Tao ZHOU
Cong-lei WANG
Jian-hong SUN
Applied Mathematics and Mechanics(English Edition), 2015, 36 (01) : 121 - 130
[35] Research on the Development and Applications of the Adaptive PID Control System Based on Location Tracking Neurons Technique
Xing, Tingting
Li, Duoyou
2015 3RD INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL SCIENCE, HUMANITIES, AND MANAGEMENT, ASSHM 2015, 2015, : 893 - 901
[36] Applications of scale-adaptive simulation technique based on one-equation turbulence model
Chang-yue Xu
Tao Zhou
Cong-lei Wang
Jian-hong Sun
Applied Mathematics and Mechanics, 2015, 36 : 121 - 130
[37] Applications of scale-adaptive simulation technique based on one-equation turbulence model
Xu, Chang-yue
Zhou, Tao
Wang, Cong-lei
Sun, Jian-hong
APPLIED MATHEMATICS AND MECHANICS-ENGLISH EDITION, 2015, 36 (01) : 121 - 130
[38] A Battery Modeling Technique Based on Fusion of Hybrid and Adaptive Algorithms for Real-Time Applications in Pure EVs
Moulik, Bedatri
Dubey, Ashwani Kumar
Ali, Ahmed M.
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (03) : 2760 - 2771
[39] Gate Diffusion Input technique based full swing and scalable 1-bit hybrid Full Adder for high performance applications
Hasan, Mehedi
Zaman, Hasan U.
Hossain, Mainul
Biswas, Parag
Islam, Sharnali
ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2020, 23 (06): : 1364 - 1373
[40] A context adaptive bit-plane coder with maximum-likelihood-based stochastic bit-reshuffling technique for scalable video coding
Peng, Wen-Hsiao
Chiang, Tihao
Hang, Hsueh-Ming
Lee, Chen-Yi
IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (04) : 654 - 667

← 1 2 3 4 5 →