Network-aware parallel computing with Remos

被引:0
|
作者
Lowekamp, B [1 ]
Miller, N [1 ]
Sutherland, D [1 ]
Gross, T [1 ]
Steenkiste, P [1 ]
Subhlok, J [1 ]
机构
[1] Carnegie Mellon Univ, Sch Comp Sci, Pittsburgh, PA 15213 USA
关键词
D O I
10.1007/3-540-48319-5_7
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Networked systems provide a cost-effective platform for parallel computing, but the applications have to deal with the changing availability of computation and communication resources. Network-awareness is a recent attempt to bridge the gap between the realities of networks and the demands of applications. Network-aware applications obtain information about their execution environment and dynamically adapt to enhance their performance. Adaptation is especially important for synchronous parallel applications since a single busy communication link can become the bottleneck and degrade overall performance dramatically. This paper presents Remos, a uniform API that allows applications to obtain relevant network information, and reports on the development of parallel applications in this environment. The challenges in defining a uniform interface include network heterogeneity, diversity and variability in network traffic, and resource sharing in the network and even inside an application. The first implementation of the Remos system is hosted on an IP-based network testbed. The paper reports on our methodology for developing adaptive parallel applications for high-speed networks with Remos, and presents results that highlight the importance and effectiveness of adaptive parallel computing.
引用
收藏
页码:100 / 119
页数:20
相关论文
共 50 条
  • [1] Network-aware distributed computing: A case study
    Tangmunarunkit, H
    Steenkiste, P
    [J]. PARALLEL AND DISTRIBUTED PROCESSING, 1998, 1388 : 171 - 182
  • [2] Network-Aware Optimization of Distributed Learning for Fog Computing
    Wang, Su
    Ruan, Yichen
    Tu, Yuwei
    Wagle, Satyavrat
    Brinton, Christopher G.
    Joe-Wong, Carlee
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2021, 29 (05) : 2019 - 2032
  • [3] Network-Aware Optimization of Distributed Learning for Fog Computing
    Tu, Yuwei
    Ruan, Yichen
    Wagle, Satyavrat
    Brinton, Christopher G.
    Joe-Wong, Carlee
    [J]. IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2020, : 2509 - 2518
  • [4] Network-aware data mapping on parallel molecular dynamics
    Hourai, Y
    Nishida, A
    Oyanagi, Y
    [J]. 11TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL I, PROCEEDINGS, 2005, : 126 - 132
  • [5] Challenging Data Management in CMS Computing with Network-Aware Systems
    Bonacorsi, Daniele
    Wildish, Tony
    [J]. 2013 IEEE NUCLEAR SCIENCE SYMPOSIUM AND MEDICAL IMAGING CONFERENCE (NSS/MIC), 2013,
  • [6] INT Based Network-Aware Task Scheduling for Edge Computing
    Shreshta, Bibek
    Cziva, Richard
    Arslan, Engin
    [J]. 2021 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2021, : 879 - 886
  • [7] Network-Aware Resource Management Strategy in Cloud Computing Environments
    Abdclaal, Marwa A.
    Ebrahim, Gamal A.
    Anis, Wagdy R.
    [J]. PROCEEDINGS OF 2016 11TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2016, : 26 - 31
  • [8] QoS-aware connection resilience for network-aware grid computing fault tolerance
    Valcarenghi, L
    Castoldi, P
    [J]. 2005 7TH INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS, VOL 1, PROCEEDINGS, 2005, : 417 - 422
  • [9] Quality of Service Provision in Fog Computing: Network-Aware Scheduling of Containers
    Caminero, Agustin C.
    Munoz-Mansilla, Rocio
    [J]. SENSORS, 2021, 21 (12)
  • [10] Mobile network-aware social computing applications: a framework, architecture, and analysis
    Seshadri Mohan
    Nitin Agarwal
    Lava Al-Doski
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2013, 4 : 43 - 56