Parallel basic matrix algebra on the grid'5000 large scale distributed platform

被引:0
|
作者
Aouad, Lamine M. [1 ]
Petiton, Serge G. [1 ]
机构
[1] Univ Sci & Technol, Lab Informat Fondamentale Lille, Lille, France
关键词
matrix algebra; the Grid'5000 platform; persistent data storage; out-of-core programming;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper we present a performance evaluation of large scale matrix algebra applications on the Grid'5000 platform. Grid'5000 is a nation wide experimental set of clusters which provide a reconfigurable and highly controllable and monitorable instrument. We test the scalability of the experimental tool and some optimization techniques for large scale matrix algebra applications in grid infrastructures based on an efficient data locality, already presented for non-dedicated grid platforms. This includes persistent data placement and explicit management of local memories on the computational nodes. We discuss the performances of a block-based matrix-vector product and the Gauss-Jordan. method for large matrix inversion. As experimental grid middleware we use the XtremWeb system to manage the Grid'5000 computational resources. We also compare these results with those obtained on large non-dedicated computational platforms distributed on two geographic sites in France and Japan. we show the effectiveness of the presented data placement techniques but that some constraints and limitations on the experimentation and underlying tools make scalability and realistic expectations more difficult.
引用
收藏
页码:528 / +
页数:3
相关论文
共 50 条
  • [31] A New Parallel and Distributed Approach for Large Scale Images Retrieval
    Belarbi, Mohammed Amin
    Mahmoudi, Sidi Ahmed
    Mahmoudi, Said
    Belalem, Ghalem
    CLOUD COMPUTING AND BIG DATA: TECHNOLOGIES, APPLICATIONS AND SECURITY, 2019, 49 : 185 - 201
  • [32] A novel parallel algorithm for large-scale Fock matrix construction with small locally distributed memory architectures:: RT parallel algorithm
    Takashima, H
    Yamada, S
    Obara, S
    Kitamura, K
    Inabata, S
    Miyakawa, N
    Tanabe, K
    Nagashima, U
    JOURNAL OF COMPUTATIONAL CHEMISTRY, 2002, 23 (14) : 1337 - 1346
  • [33] A Matrix Inversion Method with YML/OmniRPC on a Large Scale Platform
    Hugues, Maxime
    Petiton, Serge C.
    HIGH PERFORMANCE COMPUTING FOR COMPUTATIONAL SCIENCE - VECPAR 2008, 2008, 5336 : 95 - 108
  • [34] A Large-Scale Distributed Traffic Matrix Estimation Algorithm
    Ni, Jian
    Tatikonda, Sekhar
    Yeh, Edmund M.
    GLOBECOM 2006 - 2006 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, 2006,
  • [35] Aegis: A simulation grid oriented to large-scale distributed simulation
    Wu, W
    Zhou, Z
    Wang, SF
    Zhao, QP
    GRID AND COOPERATIVE COMPUTING GCC 2004, PROCEEDINGS, 2004, 3251 : 413 - 422
  • [36] The impact of large-scale distributed generation on power grid and microgrids
    Ai, Qian
    Wang, Xiaohong
    He, Xing
    RENEWABLE ENERGY, 2014, 62 : 417 - 423
  • [37] The Cambridge CFD grid for large-scale distributed CFD applications
    Yang, X
    Hayes, M
    Jenkins, K
    Cant, S
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2005, 21 (01): : 45 - 51
  • [38] Parallel Approach and Platform for Large-scale Web Data Extraction
    Shen, Yi
    Shi, Shengsheng
    Wang, Haitao
    Wei, Wu
    Yuan, Chunfeng
    Huang, Yihua
    2013 INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2013, : 192 - 196
  • [39] Distributed Platform for Large-Scale Agent-Based Simulations
    Sislak, David
    Volf, Pfemysl
    Jakob, Michal
    Pechoucek, Michal
    AGENTS FOR GAMES AND SIMULATIONS: TRENDS IN TECHNIQUES, CONCEPTS AND DESIGN, 2009, 5920 : 16 - 32
  • [40] A Workflow for Parallel and Distributed Computing of Large-Scale Genomic Data
    Choi, Hyun-Hwa
    Kim, Byoung-Seob
    Ahn, Shin-Young
    Bae, Seung-Jo
    2013 8TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), 2013, : 215 - 218