Dynamic load balancing in MPI jobs

被引:0
|
作者
Utrera, Gladys [1 ]
Corbalan, Julita [1 ]
Labarta, Jesus [1 ]
机构
[1] Univ Politecn Cataluna, Dept Arquitectura Comp, E-08028 Barcelona, Spain
来源
HIGH-PERFORMANCE COMPUTING | 2008年 / 4759卷
关键词
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
There are at least three dimensions of overhead to be considered by any parallel job scheduling algorithm: load balancing, synchronization, and communication overhead. In this work we first study several heuristics to choose the next to run from a global processes queue. After that we present a mechanism to decide at runtime weather to apply Local process queue per processor or Global processes queue per job, depending on the load balancing degree of the job, without any previous knowledge of it.
引用
收藏
页码:117 / 129
页数:13
相关论文
共 50 条
  • [1] Dynamic load balancing of MPI plus OpenMP applications
    Corbalán, J
    Duran, A
    Labarta, J
    2004 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, PROCEEDINGS, 2004, : 195 - 202
  • [2] Dynamic Load Balancing Algorithm for MPI Parallel Computing
    Sun Nian
    Liang Guangmin
    2009 INTERNATIONAL CONFERENCE ON NEW TRENDS IN INFORMATION AND SERVICE SCIENCE (NISS 2009), VOLS 1 AND 2, 2009, : 95 - +
  • [3] On-Line Predicting Behaviors of Jobs in Dynamic Load Balancing
    鞠九滨
    徐高潮
    杨鲲
    Journal of Computer Science and Technology, 1996, (01) : 39 - 49
  • [4] Dynamic Load Balancing in GPU-Based Systems for a MPI program
    Fazenda, Alvaro Luiz
    Mendes, Celso L.
    Kale, Laxmikant V.
    Panetta, Jairo
    Rodrigues, Eduardo Rocha
    2014 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2014, : 154 - 161
  • [5] Adaptive load balancing for MPI programs
    Bhandarkar, M
    Kalé, LV
    de Sturler, E
    Hoeflinger, J
    COMPUTATIONAL SCIENCE -- ICCS 2001, PROCEEDINGS PT 2, 2001, 2074 : 108 - 117
  • [6] FLEX-MPI: An MPI Extension for Supporting Dynamic Load Balancing on Heterogeneous Non-dedicated Systems
    Martin, Gonzalo
    Marinescu, Maria-Cristina
    Singh, David E.
    Carretero, Jesus
    EURO-PAR 2013 PARALLEL PROCESSING, 2013, 8097 : 138 - 149
  • [7] Load Balancing for Regular Meshes on SMPs with MPI
    Kale, Vivek
    Gropp, William
    RECENT ADVANCES IN THE MESSAGE PASSING INTERFACE, 2010, 6305 : 229 - 238
  • [8] Efficient Dynamic Load Balancing Algorithms for Multiclass Jobs in Peer to Peer Networks
    Kolla, Pavankumar
    Haripriyanka, Kola
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2011, 11 (03): : 109 - 113
  • [9] Efficient Dynamic Load Balancing Algorithms for Multiclass Jobs in Peer to Peer Networks
    Manjula, R.
    Kolla, Pavankumar
    Haripriyanka, Kolla
    WORLD CONGRESS ON ENGINEERING, WCE 2011, VOL II, 2011, : 1240 - 1244
  • [10] Balancing CPU Load for Irregular MPI Applications
    Keller, Joerg
    Majeed, Mudassar
    Kessler, Christoph W.
    APPLICATIONS, TOOLS AND TECHNIQUES ON THE ROAD TO EXASCALE COMPUTING, 2012, 22 : 307 - 316