Reproducibility Analysis of Scientific Workflows

被引:4
|
作者
Banati, Anna [3 ]
Kacsuk, Peter [1 ,2 ]
Kozlovszky, Miklos [1 ,3 ]
机构
[1] MTA SZTAKI, Pf 63, H-1518 Budapest, Hungary
[2] Univ Westminster, 115 New Cavendish St, London W1W 6UW, England
[3] Obuda Univ, John von Neumann Fac Informat, Becsi Ut 96-B, H-1034 Budapest, Hungary
关键词
scientific workflows; reproducibility; analytical model; provenance; evaluation; gUSE;
D O I
10.12700/APH.14.2.2017.2.11
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Scientific workflows are efficient tools for specifying and automating compute and data intensive in-silico experiments. An important challenge related to their usage is their reproducibility. In order to make it reproducible, many factors have to be investigated which can influence and even prevent this process: the missing descriptions and samples; the missing provenance data about the environmental parameters and the data dependencies; the dependencies of executions which are based on special hardware, changing or volatile third party services or random generated values. Some of these factors (called dependencies) can be eliminated by careful design or by huge resource usage but most of them cannot be bypassed. Our investigation deals with the critical dependencies of execution. In this paper we set up a mathematical model to evaluate the results of the workflow in addition we provide a mechanism to make the workflow reproducible based on provenance data and statistical tools.
引用
收藏
页码:201 / 217
页数:17
相关论文
共 50 条
  • [41] Scientific workflows for bibliometrics
    Arzu Tugce Guler
    Cathelijn J. F. Waaijer
    Magnus Palmblad
    Scientometrics, 2016, 107 : 385 - 398
  • [42] Reasoning on Scientific Workflows
    Lacroix, Z.
    Legendre, C. R. L.
    Tuzmen, S.
    2009 IEEE CONGRESS ON SERVICES (SERVICES-1 2009), VOLS 1 AND 2, 2009, : 306 - +
  • [43] What Makes Scientific Workflows Scientific?
    Ludaescher, Bertram
    SCIENTIFIC AND STATISTICAL DATABASE MANAGEMENT, PROCEEDINGS, 2009, 5566 : 217 - 217
  • [44] Securing Scientific Workflows
    Kim, Donghoon
    Vouk, Mladen A.
    2015 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY - COMPANION (QRS-C 2015), 2015, : 95 - 104
  • [45] Scientific workflows for bibliometrics
    Guler, Arzu Tugce
    Waaijer, Cathelijn J. F.
    Palmblad, Magnus
    SCIENTOMETRICS, 2016, 107 (02) : 385 - 398
  • [46] Collaborative Scientific Workflows
    Lu, Shiyong
    Zhang, Jia
    2009 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, VOLS 1 AND 2, 2009, : 527 - +
  • [47] Solar radiation modeling with KNIME and Solar Analyst: Increasing environmental model reproducibility using scientific workflows
    Radosevic, Nenad
    Duckham, Matt
    Liu, Gang-Jun
    Sun, Qian
    ENVIRONMENTAL MODELLING & SOFTWARE, 2020, 132
  • [48] Reproducibility and Analysis of Scientific Dataset Recommendation Methods
    Irrera, Ornella
    Lissandrini, Matteo
    Dell Aglio, Daniele
    Silvello, Gianmaria
    PROCEEDINGS OF THE EIGHTEENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS, RECSYS 2024, 2024, : 570 - 579
  • [49] Singularity Containers Improve Reproducibility and Ease of Use in Computational Image Analysis Workflows
    Mitra-Behura, Shilpita
    Fiolka, Reto Paul
    Daetwyler, Stephan
    FRONTIERS IN BIOINFORMATICS, 2022, 1
  • [50] Accelerating the scientific exploration process with scientific workflows
    Altintas, Ilkay
    Barney, Oscar
    Cheng, Zhengang
    Critchlow, Terence
    Ludaescher, Bertram
    Parker, Steve
    Shoshani, Arie
    Vouk, Mladen
    SCIDAC 2006: SCIENTIFIC DISCOVERY THROUGH ADVANCED COMPUTING, 2006, 46 : 468 - 478