Non-Strict Execution in Parallel and Distributed Computing

被引:0
|
作者
Alfredo Cristobal-Salas
Andrei Tchernykh
Jean-Luc Gaudiot
Wen-Yen Lin
机构
[1] CICESE Research Center,UCI Parallel Systems & Computer Architectures Lab, Department of Electrical and Computer Engineering
[2] University of California,undefined
[3] TIA Mobile,undefined
[4] Inc.,undefined
关键词
Incremental structures; software cache; message passing; partial evaluation; non-strict information processing;
D O I
暂无
中图分类号
学科分类号
摘要
This paper surveys and demonstrates the power of non-strict evaluation in applications executed on distributed architectures. We present the design, implementation, and experimental evaluation of single assignment, incomplete data structures in a distributed memory architecture and Abstract Network Machine (ANM). Incremental Structures (IS), Incremental Structure Software Cache (ISSC), and Dynamic Incremental Structures (DIS) provide non-strict data access and fully asynchronous operations that make them highly suited for the exploitation of fine-grain parallelism in distributed memory systems. We focus on split-phase memory operations and non-strict information processing under a distributed address space to improve the overall system performance. A novel technique of optimization at the communication level is proposed and described. We use partial evaluation of local and remote memory accesses not only to remove much of the excess overhead of message passing, but also to reduce the number of messages when some information about the input or part of the input is known. We show that split-phase transactions of IS, together with the ability of deferring reads, allow partial evaluation of distributed programs without losing determinacy. Our experimental evaluation indicates that commodity PC clusters with both IS and a caching mechanism, ISSC, are more robust. The system can deliver speedup for both regular and irregular applications. We also show that partial evaluation of memory accesses decreases the traffic in the interconnection network and improves the performance of MPI IS and MPI ISSC applications.
引用
收藏
页码:77 / 105
页数:28
相关论文
共 50 条
  • [1] Non-strict execution in parallel and distributed computing
    Cristobal-Salas, A
    Tchernykh, A
    Gaudiot, JL
    Lin, WY
    [J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2003, 31 (02) : 77 - 105
  • [2] Overlapping execution with transfer using non-strict execution for mobile programs
    Krintz, C
    Calder, B
    Lee, HB
    Zorn, BG
    [J]. ACM SIGPLAN NOTICES, 1998, 33 (11) : 159 - 169
  • [3] Towards an operational semantics for a parallel non-strict functional language
    Hall, JG
    Baker-Finch, C
    Trinder, P
    King, DJ
    [J]. IMPLEMENTATION OF FUNCTIONAL LANGUAGES, 1999, 1595 : 54 - 71
  • [4] Non-strict evaluation of the FFT algorithm in distributed memory systems
    Cristóbal-Salas, A
    Tchernykh, A
    Gaudiot, JL
    [J]. RECENT ADVANCES IN PARALLEL VIRTUAL MACHINE AND MESSAGE PASSING INTERFACE, 2003, 2840 : 188 - 195
  • [5] Motivation for Glasgow distributed Haskell, a non-strict functional language
    Trinder, PW
    [J]. PARALLEL AND DISTRIBUTED COMPUTING FOR SYMBOLIC AND IRREGULAR APPLICATIONS, 2000, : 72 - 81
  • [6] Transformation of non-strict structure-data access into scheduled strict access in non-strict dataflow languages
    Inenaga, K
    Kusakabe, S
    Amamiya, M
    [J]. PARALLEL AND DISTRIBUTED COMPUTING FOR SYMBOLIC AND IRREGULAR APPLICATIONS, 2000, : 288 - 310
  • [7] The Non-Strict Projection Lemma
    Meijer, Tomas J.
    Holicki, Tobias
    van den Eijnden, Sebastiaan
    Scherer, Carsten W.
    Heemels, W. P. M. H. Maurice
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (08) : 5584 - 5590
  • [8] Non-strict heterogeneous stacking
    Rooney, Niall
    Patterson, David
    Nugent, Chris
    [J]. PATTERN RECOGNITION LETTERS, 2007, 28 (09) : 1050 - 1061
  • [9] Non-strict Temporal Exploration
    Erlebach, Thomas
    Spooner, Jakob T.
    [J]. STRUCTURAL INFORMATION AND COMMUNICATION COMPLEXITY, SIROCCO 2020, 2020, 12156 : 129 - 145
  • [10] Strict and Non-Strict Security Boundary of Distribution Network
    Xiao, Jun
    Xiao, Jucheng
    Zhang, Liyuan
    Zu, Guoqiang
    Zhang, Baoqiang
    [J]. Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2019, 34 (12): : 2637 - 2648