The ATLAS Workflow Management System Evolution in the LHC Run3 and towards the High-Luminosity LHC era

被引：0
|
作者：
Pacheco Pages, Andres [1 ,2 ]
Klimentov, Alexei [3 ]
机构：
[1] Barcelona Inst Sci & Technol, Inst Fis Altes Energies IFAE, Campus UAB, Bellaterra 08193, Barcelona, Spain
[2] Port Informacio Cient PIC, Campus UAB, Bellaterra 08913, Cerdanyola Del, Spain
[3] Brookhaven Natl Lab, 98 Rochester St, Upton, NY 11973 USA
来源：
26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023 | 2024年 / 295卷
关键词：
D O I：
10.1051/epjconf/202429504043
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
The ATLAS experiment has 18+ years of experience using workload management systems to deploy and develop workflows to process and to simulate data on the distributed computing infrastructure. Simulation, processing and analysis of LHC experiment data require the coordinated work of heterogeneous computing resources. In particular, the ATLAS experiment utilizes the resources of 250 computing centers worldwide, the power of supercomputing centres, and national, academic and commercial cloud computing resources. In this contribution, we present new techniques for cost-effectively improving efficiency introduced in workflow management system software. The evolution from a mesh framework to new types of computing facilities such as cloud and HPCs is described, as well as new types of production and analysis workflows.
引用
收藏
页数：8
相关论文
共 50 条
  • [31] The ATLAS RPC Phase-II upgrade for High Luminosity LHC era
    Falsetti, Gregorio
    ATLAS Muon Community, A. T. L. A. S.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2024, 1068
  • [32] Double-sided silicon strip modules for the ATLAS tracker upgrade in the High-Luminosity LHC
    Gonzalez-Sevilla, S.
    Barbier, G.
    Cadoux, F.
    Clark, A.
    Endo, M.
    Favre, Y.
    Ferrere, D.
    Hanagaki, K.
    Hara, K.
    Ikegami, Y.
    La Marra, D.
    Takubo, Y.
    Terada, S.
    Unno, Y.
    Weber, M.
    JOURNAL OF INSTRUMENTATION, 2011, 6
  • [33] Evolution of the open-source data management system Rucio for LHC Run-3 and beyond ATLAS
    Barisits, Martin
    Beermann, Thomas
    Bogado, Joaquin
    Garonne, Vincent
    Javurek, Tomas
    Lassnig, Mario
    Manzi, Andrea
    Martelli, Edoardo
    Serfon, Cedric
    Wegner, Tobias
    Zhao, Xin
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [34] The ATLAS ITk strip detector system for the High Luminosity LHC upgrade
    Keller, John Stakely
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2020, 958 (958):
  • [35] Computing Activities at the Spanish Tier-1 and Tier-2s for the ATLAS experiment in the LHC Run 3 period and towards High Luminosity (HL-LHC)
    Gonzalez de la Hoz, Santiago
    Acin, Vanesa
    Accion, Esther
    Acosta-Silva, Carles
    Aparisi, Javier
    Collado Soto, Pablo
    del Peso, Jose
    Fernandez Casani, Alvaro
    Flix, Jose
    Garcia Montoro, Carlos
    Merino, Gonzalo
    Pacheco Pages, Andreu
    Planas, Elena
    Sanchez, Javier
    Salt, Jose
    Villaplana Perez, Miguel
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [36] Pile up management at the high-luminosity LHC and introduction to the crab-kissing concept
    Fartoukh, Stephane
    PHYSICAL REVIEW SPECIAL TOPICS-ACCELERATORS AND BEAMS, 2014, 17 (11):
  • [37] Low-latency hardware trigger for muons in the barrel region of the ATLAS experiment for the High-Luminosity LHC
    Bauce, Matteo
    Corradi, Massimo
    Corazzina, Lorenzo
    Gkountoumis, Panagiotis
    Ippolito, Valerio
    Luci, Claudio
    Mesolongitis, Ioannis
    Morodei, Federico
    Padovano, Giovanni
    Perrella, Sabrina
    Pacchi, Elena Pompa
    Vari, Riccardo
    JOURNAL OF INSTRUMENTATION, 2025, 20 (03):
  • [38] Conceptual design of the cryogenic system for the high-luminosity upgrade of the Large Hadron Collider (LHC)
    Brodzinski, K.
    Claudet, S.
    Ferlin, G.
    Tavian, L.
    Wagner, U.
    Van Weelderen, R.
    PROCEEDINGS OF THE 25TH INTERNATIONAL CRYOGENIC ENGINEERING CONFERENCE AND INTERNATIONAL CRYOGENIC MATERIALS CONFERENCE 2014, 2015, 67 : 60 - 65
  • [39] Application of the Universal Quench Detection System to the Protection of the High-Luminosity LHC Magnets at CERN
    Steckert, Jens
    Denz, Reiner
    Mundra, Surbhi
    Podzorny, Tomasz
    Spasic, Jelena
    Vancea, Dragos-Gabriel
    IEEE TRANSACTIONS ON APPLIED SUPERCONDUCTIVITY, 2022, 32 (06)
  • [40] Evolution of ATLAS conditions data and its management for LHC Run-2
    Boehler, Michael
    Borodin, Mikhail
    Formica, Andrea
    Gallas, Elizabeth
    Radescu, Voica
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
12345