Parallel basic matrix algebra on the grid'5000 large scale distributed platform

被引:0
|
作者
Aouad, Lamine M. [1 ]
Petiton, Serge G. [1 ]
机构
[1] Univ Sci & Technol, Lab Informat Fondamentale Lille, Lille, France
关键词
matrix algebra; the Grid'5000 platform; persistent data storage; out-of-core programming;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper we present a performance evaluation of large scale matrix algebra applications on the Grid'5000 platform. Grid'5000 is a nation wide experimental set of clusters which provide a reconfigurable and highly controllable and monitorable instrument. We test the scalability of the experimental tool and some optimization techniques for large scale matrix algebra applications in grid infrastructures based on an efficient data locality, already presented for non-dedicated grid platforms. This includes persistent data placement and explicit management of local memories on the computational nodes. We discuss the performances of a block-based matrix-vector product and the Gauss-Jordan. method for large matrix inversion. As experimental grid middleware we use the XtremWeb system to manage the Grid'5000 computational resources. We also compare these results with those obtained on large non-dedicated computational platforms distributed on two geographic sites in France and Japan. we show the effectiveness of the presented data placement techniques but that some constraints and limitations on the experimentation and underlying tools make scalability and realistic expectations more difficult.
引用
收藏
页码:528 / +
页数:3
相关论文
共 50 条
  • [21] Efficient Large Scale Distributed Matrix Computation with Spark
    Gu, Rong
    Tang, Yun
    Wang, Zhaokang
    Wang, Shuai
    Yin, Xusen
    Yuan, Chunfeng
    Huang, Yihua
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 2327 - 2336
  • [22] UIMA GRID: Distributed large-scale text analysis
    Egner, Michael Thomas
    Lorch, Markus
    Biddle, Edd
    CCGRID 2007: SEVENTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, 2007, : 317 - +
  • [23] Distributed workflow management for large-scale grid environments
    Schneider, J
    Linnert, B
    Burchard, LO
    INTERNATIONAL SYMPOSIUM ON APPLICATIONS AND THE INTERNET , PROCEEDINGS, 2006, : 229 - +
  • [24] BIGhybrid: a simulator for MapReduce applications in hybrid distributed infrastructures validated with the Grid5000 experimental platform
    Anjos, Julio C. S.
    Fedak, Gilles
    Geyer, Claudio F. R.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2416 - 2439
  • [25] A Parallel Computing Platform for Training Large Scale Neural Networks
    Gu, Rong
    Shen, Furao
    Huang, Yihua
    2013 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2013,
  • [26] Large-Scale Cloud Computing Research: Sky Computing on FutureGrid and Grid' 5000
    Riteau, Pierre
    Tsugawa, Mauricio
    Matsunaga, Andrea
    Fortes, Jose
    Keahey, Kate
    ERCIM NEWS, 2010, (83): : 41 - 42
  • [27] MICAbot: A robotic platform for large-scale distributed robotics
    McMickell, MB
    Goodwine, B
    Montestruque, LA
    2003 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-3, PROCEEDINGS, 2003, : 1600 - 1605
  • [28] A Large-Scale Distributed Video Parsing and Evaluation Platform
    Yu, Kai
    Zhou, Yang
    Li, Da
    Zhang, Zhang
    Huang, Kaiqi
    INTELLIGENT VISUAL SURVEILLANCE (IVS 2016), 2016, 664 : 37 - 43
  • [29] Autonomic runtime system for large scale parallel and distributed applications
    Yang, JM
    Chen, HP
    Kim, YU
    Hariri, S
    Parashar, M
    UNCONVENTIONAL PROGRAMMING PARADIGMS, 2005, 3566 : 297 - 311
  • [30] A Fast Parallel Large-scale Grid Generator for Parallel Computing in Engineering Simulation
    Wang, Xiaoqing
    Jin, Xianlong
    2016 IEEE INTERNATIONAL CONFERENCE OF ONLINE ANALYSIS AND COMPUTING SCIENCE (ICOACS), 2016, : 96 - 99