The ATLAS Distributed Data Management project: Past and Future

被引:17
|
作者
Garonne, Vincent [1 ]
Stewart, Graeme A. [1 ]
Lassnig, Mario [1 ]
Molfetas, Angelos [1 ]
Barisits, Martin [1 ]
Beermann, Thomas [1 ]
Nairz, Armin [1 ]
Goossens, Luc [1 ]
Megino, Fernando Barreiro [1 ]
Serfon, Cedric
Oleynik, Danila
Petrosyan, Artem
机构
[1] CERN, CH-1211 Geneva 23, Switzerland
关键词
D O I
10.1088/1742-6596/396/3/032045
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
ATLAS has recorded more than 8 petabyte(PB) of RAW data since the LHC started running at the end of 2009. Many more derived data products and complimentary simulation data have also been produced by the collaboration and, in total, 90PB are currently stored in the Worldwide LHC Computing Grid by ATLAS. All these data are managed by the ATLAS Distributed Data Management system, called Don Quijote 2 (DQ2). DQ2 has evolved rapidly to help ATLAS Computing operations manage these large quantities of data across the many grid sites at which ATLAS runs, and to help ATLAS physicists get access to these data. In this paper, we describe new and improved DQ2 services, and the experience of data management operation in ATLAS computing, showing how these services enable the management of PB scale computing operations. We also present the concepts of the new version of the ATLAS Distributed Data Management (DDM) system, Rucio.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Simulating the ATLAS Distributed Data Management System
    Barisits, Martin
    Garonne, Vincent
    Lassnig, Mario
    Molfetas, Angelos
    INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS 2012 (CHEP2012), PTS 1-6, 2012, 396
  • [2] Distributed Data Collection for the Next Generation ATLAS Eventlndex Project
    Fernandez Casani, Alvaro
    Barberis, Dario
    Sanchez, Javier
    Garcia Montoro, Carlos
    Gonzalez de la Hoz, Santiago
    Salt, Jose
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [3] A study of dynamic data placement for ATLAS distributed data management
    Beermann, T.
    Stewart, G. A.
    Maettig, P.
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [4] Classics in project management: revisiting the past, creating the future
    Soderlund, Jonas
    Geraldi, Joana
    INTERNATIONAL JOURNAL OF MANAGING PROJECTS IN BUSINESS, 2012, 5 (04) : 559 - 577
  • [5] Popularity Prediction Tool for ATLAS Distributed Data Management
    Beermann, T.
    Maettig, P.
    Stewart, G.
    Lassnig, M.
    Garonne, V.
    Barisits, M.
    Vigne, R.
    Serfon, C.
    Goossens, L.
    Nairz, A.
    Molfetas, A.
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [6] The consistency service of the ATLAS Distributed Data Management system
    Serfon, Cedric
    Garonne, Vincent
    INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2010), 2011, 331
  • [7] Integrating a dynamic data federation into the ATLAS distributed data management system
    Berghaus, Frank
    Wegner, Tobias
    Lassnig, Mario
    Ebert, Marcus
    Serfon, Cedric
    Galindo, Fernando
    Seuster, Rolf
    Garonne, Vincent
    Tafirout, Reda
    Sobie, Randall
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [9] The future of PanDA in ATLAS distributed computing
    De, K.
    Klimentov, A.
    Maeno, T.
    Nilsson, P.
    Oleynik, D.
    Panitkin, S.
    Petrosyan, A.
    Schovancova, J.
    Vaniachine, A.
    Wenaus, T.
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [10] Distributed Data Analysis in ATLAS
    Nilsson, Paul
    INTERNATIONAL CONFERENCE OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING 2009 (ICCMSE 2009), 2012, 1504 : 991 - 994