End-to-End Research Data Management Workflows A Case Study with Dendro and EUDAT

被引:0
|
作者
Silva, Fabio [1 ]
Amorim, Ricardo Carvalho [1 ]
Castro, Joao Aguiar [1 ]
da Silva, Joao Rocha [1 ]
Ribeiro, Cristina [1 ]
机构
[1] Univ Porto, Fac Engn, INESC TEC, Oporto, Portugal
关键词
METADATA;
D O I
10.1007/978-3-319-49157-8_32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Depositing and sharing research data is at the core of open science practices. However, institutions in the long tail of science are struggling to properly manage large amounts of data. Support for research data management is still fragile, and most existing solutions adopt generic metadata schemas for data description. These might be unable to capture the production contexts of many datasets, making them harder to interpret. EUDAT is a large ongoing EU-funded project that aims to provide a platform to help researchers manage their datasets and share them when they are ready to be published. Data-Publication@U. Porto is an EUDAT Data Pilot proposing the integration between Dendro, a prototype research data management platform, and the EUDAT B2Share module. The goal is to offer researchers a streamlined workflow: they organize and describe their data in Dendro as soon as they are available, and decide when to deposit in a data repository. Dendro integrates with the API of B2Share, automatically filling the standard metadata descriptors and complementing the data package with additional files for domain-specific descriptors. Our integration offers researchers a simple but complete workflow, from data preparation and description to data deposit.
引用
收藏
页码:369 / 375
页数:7
相关论文
共 50 条
  • [1] End-to-End Scientific Data Management using Workflows
    Simmhan, Yogesh
    IEEE CONGRESS ON SERVICES 2008, PT I, PROCEEDINGS, 2008, : 472 - 473
  • [2] IMF end-to-end workflows in media asset management systems
    Fernandez-Campon J.
    2018, Society of Motion Picture and Television Engineers (127): : 44 - 52
  • [3] End-to-end online performance data capture and analysis for scientific workflows
    Papadimitriou, George
    Wang, Cong
    Vahi, Karan
    da Silva, Rafael Ferreira
    Mandal, Anirban
    Liu, Zhengchun
    Mayani, Rajiv
    Rynge, Mats
    Kiran, Mariam
    Lynch, Vickie E.
    Kettimuthu, Rajkumar
    Deelman, Ewa
    Vetter, Jeffrey S.
    Foster, Ian
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 117 : 387 - 400
  • [4] Development of complex scientific workflows: towards end-to-end workflows
    Penton, D. J.
    Freebairn, A.
    Bridgart, R.
    Murray, N.
    Smith, T.
    20TH INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION (MODSIM2013), 2013, : 900 - 906
  • [5] End-to-end online performance data capture and analysis for scientific workflows
    Papadimitriou, George
    Wang, Cong
    Vahi, Karan
    da Silva, Rafael Ferreira
    Mandal, Anirban
    Liu, Zhengchun
    Mayani, Rajiv
    Rynge, Mats
    Kiran, Mariam
    Lynch, Vickie E.
    Kettimuthu, Rajkumar
    Deelman, Ewa
    Vetter, Jeffrey S.
    Foster, Ian
    Future Generation Computer Systems, 2021, 117 : 387 - 400
  • [6] A Case Study on an End-to-End Safety Risk Management Process
    Yellamati, David Deepak
    Goktas, Yavuz
    Hu, Yunwei
    2024 ANNUAL RELIABILITY AND MAINTAINABILITY SYMPOSIUM, RAMS, 2024,
  • [7] End-to-End Data Management Services for Access and Discovery of NOAA's Research Data
    Woodard, Katharine
    Mize, Jacqueline
    OCEANS 2016 MTS/IEEE MONTEREY, 2016,
  • [8] CIRRUS: a Serverless Framework for End-to-end ML Workflows
    Carreira, Joao
    Fonseca, Pedro
    Tumanov, Alexey
    Zhang, Andrew
    Katz, Randy
    PROCEEDINGS OF THE 2019 TENTH ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '19), 2019, : 13 - 24
  • [9] Research on end-to-end QoS management in UMTS network
    Yao, ZL
    Zheng, XQ
    Liu, JG
    ISTM/2003: 5TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-6, CONFERENCE PROCEEDINGS, 2003, : 1725 - 1728
  • [10] The NOAO end-to-end data management system: An overview
    Smith, R. Chris
    Dickinson, Mark
    Lowry, Sonya
    Miller, Christopher J.
    Trueblood, Mark
    Valdes, Frank
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XVI, 2007, 376 : 615 - +