A Bespoke Workflow Management System for Data-Driven Urgent HPC

被引：3

作者：

Gibb, Gordon P. S. ^{[1
]}

Brown, Nick ^{[1
]}

Nash, Rupert W. ^{[1
]}

Mendes, Miguel ^{[2
]}

Monedero, Santiago ^{[2
]}

Diaz Fidalgo, Humberto ^{[2
]}

Ramirez Cisneros, Joaquin ^{[2
]}

Cardil, Adrian ^{[2
]}

Kontak, Max ^{[3
]}

机构：

[1] Univ Edinburgh, EPCC, Bayes Ctr, 47 Potterrow, Edinburgh EH8 9BT, Midlothian, Scotland

[2] Edificio Tecnosylva,Parque Tecnol Leon, Leon 24009, Spain

[3] DLR German Aerosp Ctr, Inst Software Technol High Performance Comp, D-51147 Cologne, Germany

来源：

PROCEEDINGS OF URGENTHPC 2020: THE IEEE/ACM INTERNATIONAL WORKSHOPS ON URGENT AND INTERACTIVE HPC | 2020年

基金：

欧盟地平线“2020”;

关键词：

D O I：

10.1109/UrgentHPC51945.2020.00007

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in order refine the predictions as time goes on. This allows the workflow to adapt to new data at runtime, a capability that most workflow management systems do not possess. The workflow management system was developed for the EU-funded VESTEC project, which aims to fuse HPC with real-time data for supporting urgent decision making. We first describe an example workflow from the VESTEC project, and show why existing workflow technologies do not meet the needs of the project. We then go on to present the design of our Workflow Management System, describe how it is implemented into the VESTEC system, and provide an example of the workflow system in use for a test case.

引用

页码：10 / 20

页数：11

共 50 条

[1] Implementation of a Data-driven Workflow Management System
Haddar, Nahla
Tmar, Mohamed
Gargouri, Faiez
[J]. 15TH IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2012) / 10TH IEEE/IFIP INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (EUC 2012), 2012, : 111 - 118
[2] Research on Data-Driven in Business Workflow System Design
Zhou, ChuanSheng
[J]. ADVANCES IN COMPUTER SCIENCE AND EDUCATION, 2012, 140 : 39 - 45
[3] Data-Driven Job Dispatching in HPC Systems
Galleguillos, Cristian
Sirbu, Alina
Kiziltan, Zeynep
Babaoglu, Ozalp
Borghesi, Andrea
Bridi, Thomas
[J]. MACHINE LEARNING, OPTIMIZATION, AND BIG DATA, MOD 2017, 2018, 10710 : 449 - 461
[4] Exploring HPC Parallelism with Data-Driven Multithreating
Christofi, Constantinos
Michael, George
Trancoso, Pedro
Evripidou, Paraskevas
[J]. 2012 SECOND WORKSHOP ON DATA-FLOW EXECUTION MODELS FOR EXTREME SCALE COMPUTING (DFM 2012), 2012, : 10 - 17
[5] An Interactive Data-Driven HPC System for Forecasting Weather, Wildland Fire, and Smoke
Mandel, Jan
Vejmelka, Martin
Kochanski, Adam K.
Farguell, Angel
Haley, James D.
Mallia, Derek V.
Hilburn, Kyle
[J]. PROCEEDINGS OF URGENTHPC: 2019 FIRST IEEE/ACM INTERNATIONAL WORKSHOP ON HPC FOR URGENT DECISION MAKING (URGENTHPC), 2019, : 35 - 44
[6] Data-Driven Techniques in Computing System Management
Li, Tao
Zeng, Chunqiu
Jiang, Yexi
Zhou, Wubai
Tang, Liang
Liu, Zheng
Huang, Yue
[J]. ACM COMPUTING SURVEYS, 2017, 50 (03)
[7] A Data-driven Human Responsibility Management System
Tang, Xuejiao
Qiu, Jiong
Chen, Ruijun
Zhang, Wenbin
Iosifidis, Vasileios
Liu, Zhen
Meng, Wei
Zhang, Mingli
Zhang, Ji
[J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 5834 - 5838
[8] Data-driven HR Analytics in a Quality Management System
Polyakova, Alexandra
Kolmakov, Vladimir
Pokamestov, Ilya
[J]. QUALITY-ACCESS TO SUCCESS, 2020, 21 (176): : 74 - 80
[9] An Integrated Data-Driven Framework for Computing System Management
Li, Tao
Peng, Wei
Perng, Charles
Ma, Sheng
Wang, Haixun
[J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2010, 40 (01): : 90 - 99
[10] An Integrated Data-Driven System for Digital Bridge Management
Pallante, Luigi
Meriggi, Pietro
D'Amico, Fabrizio
Gagliardi, Valerio
Napolitano, Antonio
Paolacci, Fabrizio
Quinci, Gianluca
Lorello, Mario
de Felice, Gianmarco
[J]. BUILDINGS, 2024, 14 (01)

← 1 2 3 4 5 →