Distributed and Adaptive Execution of Condor DAGMan Workflows

被引:0
|
作者
Kalayci, Selim [1 ]
Dasgupta, Gargi [2 ]
Fong, Liana [3 ]
Ezenwoye, Onyeka [4 ]
Sadjadi, S. Masoud [1 ]
机构
[1] Florida Int Univ, Miami, FL 33199 USA
[2] IBM India Res Lab, New Delhi, India
[3] IBM Watson Res Ctr, Hawthorne, NY USA
[4] South Dakota State Univ, Brookings, SD 57007 USA
来源
22ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING & KNOWLEDGE ENGINEERING (SEKE 2010) | 2010年
关键词
Decentralized adaptive workflow execution;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper presents a decentralized execution approach to large-scale workflows on multiple resource domains. This approach includes a low overhead, decentralized runtime adaptation mechanism that improves the performance of the system. A prototype implementation based on standard Condor DAGMan workflow execution engine, does not require any modifications to Condor or its underlying system.
引用
收藏
页码:587 / 590
页数:4
相关论文
共 50 条
  • [21] Execution of service workflows in grid environments
    Senna, C. R.
    Bittencourt, L. F.
    Madeira, E. R. M.
    INTERNATIONAL JOURNAL OF COMMUNICATION NETWORKS AND DISTRIBUTED SYSTEMS, 2010, 5 (1-2) : 88 - 108
  • [22] Execution Support to Long Running Workflows
    Junior, Milton S. S.
    Rosa, Nelson S.
    Lins, Fernando A. A.
    2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (CIT), 2014, : 496 - 503
  • [23] Netherite: Efficient Execution of Serverless Workflows
    Burckhardt, Sebastian
    Chandramouli, Badrish
    Gillum, Chris
    Justo, David
    Kallas, Konstantinos
    McMahon, Connor
    Meiklejohn, Christopher S.
    Zhu, Xiangfeng
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2022, 15 (08): : 1591 - 1604
  • [24] Dynamic Execution of Scientific Workflows in Cloud
    Kail, E.
    Kovacs, J.
    Kozlovszky, M.
    Kacsuk, P.
    2016 39TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2016, : 332 - 336
  • [25] Netherite: efficient execution of serverless workflows
    Burckhardt, Sebastian
    Chandramouli, Badrish
    Gillum, Chris
    Justo, David
    Kallas, Konstantinos
    Mcmahon, Connor
    Meiklejohn, Christopher S.
    Zhu, Xiangfeng
    VLDB JOURNAL, 2025, 34 (02):
  • [26] Probabilistic calculation of execution intervals for workflows
    Eder, J
    Pichler, H
    12th International Symposium on Temporal Representation and Reasoning, Proceedings, 2005, : 183 - 185
  • [27] Execution of Service Workflows in Grid Environments
    Senna, Carlos R.
    Bittencourt, Luiz F.
    Madeira, Edmundo R. M.
    2009 5TH INTERNATIONAL CONFERENCE ON TESTBEDS AND RESEARCH INFRASTRUCTURES FOR THE DEVELOPMENT OF NETWORKS & COMMUNITIES, 2009, : 6 - 15
  • [28] THE CONDOR DISTRIBUTED-PROCESSING SYSTEM
    TANNENBAUM, T
    LITZKOW, M
    DR DOBBS JOURNAL, 1995, 20 (02): : 40 - &
  • [29] An Insight Into The Architecture Of Condor - A Distributed Scheduler
    Liu, Chang
    Zhao, Zhiwen
    Liu, Fang
    2009 INTERNATIONAL SYMPOSIUM ON COMPUTER NETWORK AND MULTIMEDIA TECHNOLOGY (CNMT 2009), VOLUMES 1 AND 2, 2009, : 1164 - 1167
  • [30] Distributed computing in practice: the Condor experience
    Thain, D
    Tannenbaum, T
    Livny, M
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2005, 17 (2-4): : 323 - 356