Rucio: Scientific Data Management

被引：79

作者：

Barisits M. ^{[1
]}

Beermann T. ^{[2
]}

Berghaus F. ^{[3
]}

Bockelman B. ^{[4
]}

Bogado J. ^{[5
]}

Cameron D. ^{[6
]}

Christidis D. ^{[7
]}

Ciangottini D. ^{[8
]}

Dimitrov G. ^{[1
]}

Elsing M. ^{[1
]}

Garonne V. ^{[6
]}

di Girolamo A. ^{[1
]}

Goossens L. ^{[1
]}

Guan W. ^{[9
]}

Guenther J. ^{[1
]}

Javurek T. ^{[1
]}

Kuhn D. ^{[10
]}

Lassnig M. ^{[1
]}

Lopez F. ^{[5
]}

Magini N. ^{[11
]}

Molfetas A. ^{[1
]}

Nairz A. ^{[1
]}

Ould-Saada F. ^{[6
]}

Prenner S. ^{[10
]}

Serfon C. ^{[10
]}

Stewart G. ^{[1
]}

Vaandering E. ^{[12
]}

Vasileva P. ^{[1
]}

Vigne R. ^{[13
]}

Wegner T. ^{[1
]}

机构：

[1] CERN, Meyrin

[2] University of Wuppertal, Wuppertal

[3] University of Victoria, Victoria

[4] Morgridge Institute, Madison, WI

[5] Universidad Nacional de La Plata, La Plata

[6] University of Oslo, Oslo

[7] University of Texas at Arlington, Arlington, TX

[8] INFN, Perugia

[9] University of Wisconsin-Madison, Madison, WI

[10] University of Innsbruck, Innsbruck

[11] Iowa State University, Ames, IA

[12] Fermi National Accelerator Laboratory, Batavia, IL

[13] University of Vienna, Vienna

来源：

Computing and Software for Big Science | 2019年 / 3卷 / 1期

关键词：

Data access; Data management; Data organization; Distributed computing; Exascale;

D O I：

10.1007/s41781-019-0026-3

中图分类号：

学科分类号：

摘要：

Rucio is an open-source software framework that provides scientific collaborations with the functionality to organize, manage, and access their data at scale. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio was originally developed to meet the requirements of the high-energy physics experiment ATLAS, and now is continuously extended to support the LHC experiments and other diverse scientific communities. In this article, we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and report operational experience from production usage. © 2019, The Author(s).

引用

共 50 条

[1] Rucio, the next-generation Data Management system in ATLAS
Serfon, C.
Barisits, M.
Beermann, T.
Garonne, V.
Goossens, L.
Lassnig, M.
Nairz, A.
Vigne, R.
NUCLEAR AND PARTICLE PHYSICS PROCEEDINGS, 2016, 273 : 969 - 975
[2] Monitoring and controlling ATLAS data management: The Rucio web user interface
Lassnig, M.
Beermann, T.
Vigne, R.
Barisits, M.
Garonne, V.
Serfon, C.
21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
[3] Rucio - The next generation of large scale distributed system for ATLAS Data Management
Garonne, V.
Vigne, R.
Stewart, G.
Barisits, M.
Beermann, T.
Lassnig, M.
Serfon, C.
Goossens, L.
Nairz, A.
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[4] Resource control in ATLAS distributed data management: Rucio Accounting and Quotas
Barisits, M.
Serfon, C.
Garonne, V.
Lassnig, M.
Beermann, T.
Vigne, R.
21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
[5] Transitioning CMS to Rucio Data Managment
Vaandering, Eric
24TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2019), 2020, 245
[6] Scalable and fail-safe deployment of the ATLAS Distributed Data Management system Rucio
Lassnig, M.
Vigne, R.
Beermann, T.
Barisits, M.
Garonne, V.
Serfon, C.
21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
[7] The ATLAS Data Management System Rucio: Supporting LHC Run-2 and beyond
Barisits, M.
Beermann, T.
Garonne, V.
Javurek, T.
Lassnig, M.
Serfon, C.
18TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2017), 2018, 1085
[8] The DMLite Rucio Plugin: ATLAS data in a filesystem
Lassnig, M.
van Dongen, D.
Da Rocha, R. Brito
Ayllon, A. Alvarez
Calfayan, P.
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[9] ATLAS Replica Management in Rucio: Replication Rules and Subscriptions
Barisits, M.
Serfon, C.
Garonne, V.
Lassnig, M.
Stewart, G.
Beermann, T.
Vigne, R.
Goossens, L.
Nairz, A.
Molfetas, A.
20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[10] Active management of scientific data
Plale, B
Gannon, D
Alameda, J
Wilhelmson, B
Hampton, S
Rossi, A
Droegemeier, K
IEEE INTERNET COMPUTING, 2005, 9 (01) : 27 - 34

← 1 2 3 4 5 →