Distributed and Adaptive Execution of Condor DAGMan Workflows

被引:0
|
作者
Kalayci, Selim [1 ]
Dasgupta, Gargi [2 ]
Fong, Liana [3 ]
Ezenwoye, Onyeka [4 ]
Sadjadi, S. Masoud [1 ]
机构
[1] Florida Int Univ, Miami, FL 33199 USA
[2] IBM India Res Lab, New Delhi, India
[3] IBM Watson Res Ctr, Hawthorne, NY USA
[4] South Dakota State Univ, Brookings, SD 57007 USA
来源
22ND INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING & KNOWLEDGE ENGINEERING (SEKE 2010) | 2010年
关键词
Decentralized adaptive workflow execution;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
This paper presents a decentralized execution approach to large-scale workflows on multiple resource domains. This approach includes a low overhead, decentralized runtime adaptation mechanism that improves the performance of the system. A prototype implementation based on standard Condor DAGMan workflow execution engine, does not require any modifications to Condor or its underlying system.
引用
收藏
页码:587 / 590
页数:4
相关论文
共 50 条
  • [1] Distributed execution of workflows
    Navas-Delgado, Ismael
    Aldana-Montes, Jose F.
    Trelles, Oswaldo
    COMPUTATIONAL SCIENCE - ICCS 2006, PT 3, PROCEEDINGS, 2006, 3993 : 936 - 939
  • [2] Distributed execution of workflows in the INB
    Navas-Delgado, Ismael
    Perez, Antonio J.
    Aldana-Montes, Jose F.
    Trelles, Swaldo
    DATA INTEGRATION IN THE LIFE SCIENCES, PROCEEDINGS, 2006, 4075 : 224 - 231
  • [3] An approach to adaptive distributed execution monitoring for workflows in service-based systems
    Yau, Stephen S.
    Huang, Dazhi
    Zhu, Luping
    COMPSAC 2007: THE THIRTY-FIRST ANNUAL INTERNATIONAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE, VOL II, PROCEEDINGS, 2007, : 211 - +
  • [4] Approaches to Distributed Execution of Scientific Workflows in Kepler
    Plociennik, Marcin
    Zok, Tomasz
    Altintas, Ilkay
    Wang, Jianwu
    Crawl, Daniel
    Abramson, David
    Imbeaux, Frederic
    Guillerminet, Bernard
    Lopez-Caniego, Marcos
    Campos Plasencia, Isabel
    Pych, Wojciech
    Ciecielag, Pawel
    Palak, Bartek
    Owsiak, Michal
    Frauel, Yann
    FUNDAMENTA INFORMATICAE, 2013, 128 (03) : 281 - 302
  • [5] A Modeling and execution environment for distributed scientific workflows
    Altintas, I
    Bhagwanani, S
    Buttler, D
    Chandra, S
    Cheng, ZG
    Coleman, MA
    Critchlow, T
    Gupta, A
    Han, W
    Liu, L
    Ludäscher, B
    Pu, C
    Moore, R
    Shoshani, A
    Vouk, M
    SSDBM 2002: 15TH INTERNATIONAL CONFERENCE ON SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, 2003, : 247 - 250
  • [6] An execution environment as a service for adaptive long-running workflows
    Souza-Junior, Milton Secundino de
    Rosa, Nelson Souto
    Lins, Fernando Antonio Aires
    INTERNATIONAL JOURNAL OF WEB INFORMATION SYSTEMS, 2021, 17 (02) : 117 - 139
  • [7] Execution of the SimSET Monte Carlo PET/SPECT Simulator in the Condor Distributed Computing Environment
    Karl G. Baum
    María Helguera
    Journal of Digital Imaging, 2007, 20 : 72 - 82
  • [8] Execution of the SimSET Monte Carlo PET/SPECT simulator in the condor distributed computing environment
    Baum, Karl G.
    Helguera, Maria
    JOURNAL OF DIGITAL IMAGING, 2007, 20 (Suppl 1) : 72 - 82
  • [9] An adaptive parallel execution strategy for cloud-based scientific workflows
    de Oliveira, Daniel
    Ogasawara, Eduardo
    Ocana, Kary
    Baiao, Fernanda
    Mattoso, Marta
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2012, 24 (13): : 1531 - 1550
  • [10] Adaptive Execution of Continuous and Data-intensive Workflows with Machine Learning
    Esteves, Sergio
    Galhardas, Helena
    Veiga, Luis
    MIDDLEWARE'18: PROCEEDINGS OF THE 2018 ACM/IFIP/USENIX MIDDLEWARE CONFERENCE, 2018, : 239 - 252