The ATLAS Distributed Data Management project: Past and Future

被引:17
|
作者
Garonne, Vincent [1 ]
Stewart, Graeme A. [1 ]
Lassnig, Mario [1 ]
Molfetas, Angelos [1 ]
Barisits, Martin [1 ]
Beermann, Thomas [1 ]
Nairz, Armin [1 ]
Goossens, Luc [1 ]
Megino, Fernando Barreiro [1 ]
Serfon, Cedric
Oleynik, Danila
Petrosyan, Artem
机构
[1] CERN, CH-1211 Geneva 23, Switzerland
来源
INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS 2012 (CHEP2012), PTS 1-6 | 2012年 / 396卷
关键词
D O I
10.1088/1742-6596/396/3/032045
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
ATLAS has recorded more than 8 petabyte(PB) of RAW data since the LHC started running at the end of 2009. Many more derived data products and complimentary simulation data have also been produced by the collaboration and, in total, 90PB are currently stored in the Worldwide LHC Computing Grid by ATLAS. All these data are managed by the ATLAS Distributed Data Management system, called Don Quijote 2 (DQ2). DQ2 has evolved rapidly to help ATLAS Computing operations manage these large quantities of data across the many grid sites at which ATLAS runs, and to help ATLAS physicists get access to these data. In this paper, we describe new and improved DQ2 services, and the experience of data management operation in ATLAS computing, showing how these services enable the management of PB scale computing operations. We also present the concepts of the new version of the ATLAS Distributed Data Management (DDM) system, Rucio.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Oncology animal study data collection and management practices: Past, present, and future
    Ibsen, Eric M.
    MOLECULAR CANCER THERAPEUTICS, 2007, 6 (12) : 3402S - 3402S
  • [42] Following the Data: Past, Present, and Future Management of the Axilla in Breast Cancer Patients
    Mittendorf, Elizabeth A.
    Hunt, Kelly K.
    ONCOLOGY-NEW YORK, 2014, 28 (05): : 378 - +
  • [43] Big Data Management: What to Keep from the Past to Face Future Challenges?
    Vargas-Solar G.
    Zechinelli-Martini J.L.
    Espinosa-Oviedo J.A.
    Data Science and Engineering, 2017, 2 (4) : 328 - 345
  • [44] PROJECT-MANAGEMENT OF THE FUTURE
    TAPPAN, DS
    COLUMBIA JOURNAL OF WORLD BUSINESS, 1985, 20 (04): : 27 - 29
  • [45] Future Trends in Project Management
    Paredes, Catia
    Ribeiro, Pedro
    2018 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS (IS), 2018, : 637 - 644
  • [46] Research and the future of project management
    Morris, Peter W. G.
    INTERNATIONAL JOURNAL OF MANAGING PROJECTS IN BUSINESS, 2010, 3 (01) : 139 - 146
  • [47] A Distributed Software Project Management Framework
    Sarker, Kamal Uddin
    Hasan, Raza
    Bin Deraman, Aziz
    Mahmmod, Salman
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2023, 14 (04) : 685 - 693
  • [48] DISTRIBUTED COGNITION MODEL FOR PROJECT MANAGEMENT
    Fernandes, Roberto Godoy
    Vils, Leonardo
    da Silva, Luciano Ferreira
    REVISTA GESTAO & TECNOLOGIA-JOURNAL OF MANAGEMENT AND TECHNOLOGY, 2023, 23 (03): : 85 - 127
  • [49] Nextmove: A distributed project management tool
    Mak, David K. M.
    Kruchten, Philippe K.
    PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, 2007, : 13 - +
  • [50] Distributed serum in research project management
    Marchesi, Michele
    Mannaro, Katiuscia
    Uras, Selene
    Locci, Mario
    AGILE PROCESSES IN SOFTWARE ENGINEERING AND EXTREME PROGRAMMING, PROCEEDINGS, 2007, 4536 : 240 - +