Parallel basic matrix algebra on the grid'5000 large scale distributed platform

被引:0
|
作者
Aouad, Lamine M. [1 ]
Petiton, Serge G. [1 ]
机构
[1] Univ Sci & Technol, Lab Informat Fondamentale Lille, Lille, France
关键词
matrix algebra; the Grid'5000 platform; persistent data storage; out-of-core programming;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper we present a performance evaluation of large scale matrix algebra applications on the Grid'5000 platform. Grid'5000 is a nation wide experimental set of clusters which provide a reconfigurable and highly controllable and monitorable instrument. We test the scalability of the experimental tool and some optimization techniques for large scale matrix algebra applications in grid infrastructures based on an efficient data locality, already presented for non-dedicated grid platforms. This includes persistent data placement and explicit management of local memories on the computational nodes. We discuss the performances of a block-based matrix-vector product and the Gauss-Jordan. method for large matrix inversion. As experimental grid middleware we use the XtremWeb system to manage the Grid'5000 computational resources. We also compare these results with those obtained on large non-dedicated computational platforms distributed on two geographic sites in France and Japan. we show the effectiveness of the presented data placement techniques but that some constraints and limitations on the experimentation and underlying tools make scalability and realistic expectations more difficult.
引用
收藏
页码:528 / +
页数:3
相关论文
共 50 条
  • [1] Grid'5000: A Large Scale Reconfigurable and Controllable Platform for Research in Computer Science
    Cappello, Franck
    DCABES 2008 PROCEEDINGS, VOLS I AND II, 2008, : 1 - 7
  • [2] Grid'5000:: A large scale and highly reconfigurable experimental grid testbed
    Bolze, Raphael
    Cappello, Franck
    Caron, Eddy
    Dayde, Michel
    Desprez, Frederic
    Jeannot, Emmanuel
    Jegou, Yvon
    Lanteri, Stephane
    Leduc, Julien
    Melab, Noredine
    Mornet, Guillaume
    Namyst, Raymond
    Primet, Pascale
    Quetier, Benjamin
    Richard, Olivier
    Talbi, El-Ghazali
    Touche, Irea
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2006, 20 (04): : 481 - 494
  • [3] Grid'5000: a large scale and highly reconfigurable Grid experimental testbed
    Cappello, F
    Caron, E
    Desprez, F
    Jegou, Y
    Primet, P
    Jeannot, E
    2005 6TH INTERNATIONAL WORKSHOP ON GRID COMPUTING (GRID), 2005, : 99 - 106
  • [4] Hierarchical Parallel Matrix Multiplication on Large-Scale Distributed Memory Platforms
    Quintin, Jean-Noel
    Hasanov, Khalid
    Lastovetsky, Alexey
    2013 42ND ANNUAL INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING (ICPP), 2013, : 754 - 762
  • [5] A Refined Distributed Parallel Algorithm For The Eigenvalue Problem Of Large-scale Matrix
    Zhao, Lu
    Zhuang, Yi
    Liu, Yi
    Ni, Tian Quan
    2010 3RD INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI 2010), VOLS 1-7, 2010, : 2780 - 2784
  • [6] Towards Parallel Large-scale Genomic Prediction by Coupling Sparse and Dense Matrix Algebra
    De Coninck, Arne
    Kourounis, Drosos
    Verbosio, Fabio
    Schenk, Olaf
    De Baets, Bernard
    Maenhout, Steven
    Fostier, Jan
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 747 - 750
  • [7] ZenLDA: Large-Scale Topic Model Training on Distributed Data-Parallel Platform
    Bo Zhao
    Hucheng Zhou
    Guoqiang Li
    Yihua Huang
    Big Data Mining and Analytics, 2018, (01) : 57 - 74
  • [8] ZenLDA: Large-Scale Topic Model Training on Distributed Data-Parallel Platform
    Zhao, Bo
    Zhou, Hucheng
    Li, Guoqiang
    Huang, Yihua
    BIG DATA MINING AND ANALYTICS, 2018, 1 (01): : 57 - 74
  • [9] A Large Scale Grid Data Analysis Platform for DSOs
    Kadam, Serdar
    Bletterie, Benoit
    Gawlik, Wolfgang
    ENERGIES, 2017, 10 (08):
  • [10] Parallel Nonnegative Matrix Factorization Algorithm on the Distributed Memory Platform
    Dong, Chao
    Zhao, Huijie
    Wang, Wei
    INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2010, 38 (02) : 117 - 137