Parallel basic matrix algebra on the grid'5000 large scale distributed platform

被引:0
|
作者
Aouad, Lamine M. [1 ]
Petiton, Serge G. [1 ]
机构
[1] Univ Sci & Technol, Lab Informat Fondamentale Lille, Lille, France
关键词
matrix algebra; the Grid'5000 platform; persistent data storage; out-of-core programming;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper we present a performance evaluation of large scale matrix algebra applications on the Grid'5000 platform. Grid'5000 is a nation wide experimental set of clusters which provide a reconfigurable and highly controllable and monitorable instrument. We test the scalability of the experimental tool and some optimization techniques for large scale matrix algebra applications in grid infrastructures based on an efficient data locality, already presented for non-dedicated grid platforms. This includes persistent data placement and explicit management of local memories on the computational nodes. We discuss the performances of a block-based matrix-vector product and the Gauss-Jordan. method for large matrix inversion. As experimental grid middleware we use the XtremWeb system to manage the Grid'5000 computational resources. We also compare these results with those obtained on large non-dedicated computational platforms distributed on two geographic sites in France and Japan. we show the effectiveness of the presented data placement techniques but that some constraints and limitations on the experimentation and underlying tools make scalability and realistic expectations more difficult.
引用
收藏
页码:528 / +
页数:3
相关论文
共 50 条
  • [41] THE DUAL BACKBONE NETWORK - DISTRIBUTED AND PARALLEL PROCESSING ON A LARGE-SCALE
    ENDRIZZI, A
    COMPUTER NETWORKS AND ISDN SYSTEMS, 1987, 14 (2-5): : 373 - 381
  • [42] Large-scale parallel reservoir simulation on distributed memory systems
    Cao, JW
    Pan, F
    Sun, JC
    Liu, W
    DCABES 2001 PROCEEDINGS, 2001, : 98 - 103
  • [43] A Robust Parallel Distributed State Estimation for Large Scale Distribution Systems
    Yilmaz, Ugur Can
    Abur, Ali
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2024, 39 (02) : 4437 - 4445
  • [44] Large-Scale Subspace Clustering by Independent Distributed and Parallel Coding
    Li, Jun
    Tao, Zhiqiang
    Wu, Yue
    Zhong, Bineng
    Fu, Yun
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (09) : 9090 - 9100
  • [45] Algebra of RDF Graphs for Querying Large-Scale Distributed Triple-Store
    Savnik, Iztok
    Nitta, Kiyoshi
    AVAILABILITY, RELIABILITY, AND SECURITY IN INFORMATION SYSTEMS, CD-ARES 2016, PAML 2016, 2016, 9817 : 3 - 18
  • [46] Parallel gravitational clustering based on grid partitioning for large-scale data
    Lei Chen
    Fadong Chen
    Zhaohua Liu
    Mingyang Lv
    Tingqin He
    Shiwen Zhang
    Applied Intelligence, 2023, 53 : 2506 - 2526
  • [47] PARALLEL AND LARGE-SCALE MATRIX COMPUTATIONS IN CONTROL - SOME IDEAS
    DATTA, BN
    LINEAR ALGEBRA AND ITS APPLICATIONS, 1989, 121 : 243 - 264
  • [48] Parallel stochastic gradient algorithms for large-scale matrix completion
    Recht B.
    Ré C.
    Mathematical Programming Computation, 2013, 5 (2) : 201 - 226
  • [49] Parallel gravitational clustering based on grid partitioning for large-scale data
    Chen, Lei
    Chen, Fadong
    Liu, Zhaohua
    Lv, Mingyang
    He, Tingqin
    Zhang, Shiwen
    APPLIED INTELLIGENCE, 2023, 53 (03) : 2506 - 2526
  • [50] Large-scale parallel simulation with implicit conservative overlapped grid for flow
    Wang, Ziwei
    Fan, Zhaolin
    Liu, Fan
    Jiang, Xiong
    Li, Bin
    Qiu, Ming
    COMPUTERS & FLUIDS, 2022, 238