Rucio: Scientific Data Management

被引：79

作者：

Barisits M. ^{[1
]}

Beermann T. ^{[2
]}

Berghaus F. ^{[3
]}

Bockelman B. ^{[4
]}

Bogado J. ^{[5
]}

Cameron D. ^{[6
]}

Christidis D. ^{[7
]}

Ciangottini D. ^{[8
]}

Dimitrov G. ^{[1
]}

Elsing M. ^{[1
]}

Garonne V. ^{[6
]}

di Girolamo A. ^{[1
]}

Goossens L. ^{[1
]}

Guan W. ^{[9
]}

Guenther J. ^{[1
]}

Javurek T. ^{[1
]}

Kuhn D. ^{[10
]}

Lassnig M. ^{[1
]}

Lopez F. ^{[5
]}

Magini N. ^{[11
]}

Molfetas A. ^{[1
]}

Nairz A. ^{[1
]}

Ould-Saada F. ^{[6
]}

Prenner S. ^{[10
]}

Serfon C. ^{[10
]}

Stewart G. ^{[1
]}

Vaandering E. ^{[12
]}

Vasileva P. ^{[1
]}

Vigne R. ^{[13
]}

Wegner T. ^{[1
]}

机构：

[1] CERN, Meyrin

[2] University of Wuppertal, Wuppertal

[3] University of Victoria, Victoria

[4] Morgridge Institute, Madison, WI

[5] Universidad Nacional de La Plata, La Plata

[6] University of Oslo, Oslo

[7] University of Texas at Arlington, Arlington, TX

[8] INFN, Perugia

[9] University of Wisconsin-Madison, Madison, WI

[10] University of Innsbruck, Innsbruck

[11] Iowa State University, Ames, IA

[12] Fermi National Accelerator Laboratory, Batavia, IL

[13] University of Vienna, Vienna

来源：

Computing and Software for Big Science | 2019年 / 3卷 / 1期

关键词：

Data access; Data management; Data organization; Distributed computing; Exascale;

D O I：

10.1007/s41781-019-0026-3

中图分类号：

学科分类号：

摘要：

Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and report operational experience from production usage. © 2019, The Author(s).

引用

共 50 条

[41] Scientific Data and Knowledge Management in Aerospace Engineering
Schreiber, Andreas
Ruehmkorf, Jens
Seider, Doreen
2009 THIRD INTERNATIONAL CONFERENCE ON ADVANCED ENGINEERING COMPUTING AND APPLICATIONS IN SCIENCES (ADVCOMP 2009), 2009, : 111 - 116
[42] Scientific data management: An orphan in the database community?
Burns, Randal
2008 IEEE 24TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2008, : 9 - 9
[43] GODIVA: Lightweight data management for scientific visualization applications
Ma, XS
Winslett, M
Norris, J
Jiao, XM
Fiedler, R
20TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS, 2004, : 732 - 743
[44] Big Data: from scientific research to business management
Ramon Areces, Fundacion
REVISTA DE OCCIDENTE, 2014, (400) : 120 - 123
[45] New directions in scientific software: Lab data management
Anon
Scientific Computing and Instrumentation, 2000, 17 (04):
[46] Data Provenance for Experiment Management of Scientific Applications on GPU
Kim, Sejin
Oh, Jisun
Kim, Yoonhee
2019 20TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2019,
[47] A Network Management System for Handling Scientific Data Flows
Zhenzhen Yan
Chris Tracy
Malathi Veeraraghavan
Tian Jin
Zhengyang Liu
Journal of Network and Systems Management, 2016, 24 : 1 - 33
[48] National Registry of Scientific Data Management Plans by IBICT
Correa da Silva, Fabiano Couto
de Souza de Aguiar Monteiro, Elizabete Cristina
Rodrigues, Marcello Mundim
Mardero Arellano, Miguel Angel
de Oliveira, Alexandre Faria
DATA AND INFORMATION IN ONLINE ENVIRONMENTS, DIONE 2022, 2022, 452 : 29 - 38
[49] High-performance scientific data management system
No, JC
Thakur, R
Choudhary, A
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2003, 63 (04) : 434 - 447
[50] Improve the scientific management of University with data mining techniques
Chen Jianyong
2010 INTERNATIONAL CONFERENCE ON EDUCATION AND SPORTS EDUCATION, VOL 1, 2010, : 414 - 417

← 1 2 3 4 5 →