The Cherenkov Telescope Array Observatory workflow management system

被引:0
|
作者
Arrabito, Luisa [1 ]
Bregeon, Johan [2 ]
Faure, Alice [1 ]
Gueta, Orel [3 ]
Pigoux, Natthan [1 ]
Tsaregorodtsev, Andrei [4 ]
机构
[1] CNRS, IN2P3, Lab Univers & Particules Montpellier, Montpellier, France
[2] CNRS, IN2P3, Lab Phys Subatom & Cosmol, Grenoble, France
[3] Deutsch Elektronen Synchrotron DESY, Platanenallee 6, Zeuthen, Germany
[4] Aix Marseille Univ, CNRS, IN2P3, CPPM, Marseille, France
关键词
D O I
10.1051/epjconf/202429504044
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Cherenkov Telescope Array Observatory (CTAO) is the next generation ground-based observatory for gamma-ray astronomy at very high energies. It is expected to produce about 2 PB of raw data each year and to manage a global data volume which will grow through the years to reach about 100 PB in 2030. In addition, CTAO will require a high computing capacity for data processing and Monte Carlo simulations, of the order of hundreds of millions of CPU HS06 hours per year. To meet these requirements, CTAO will adopt a distributed computing model using 4 academic data centers, and will use the DIRAC framework as its workload management system. In the past ten years, to optimize the instrument design and study its performances, CTAO has used the European Grid Infrastructure (EGI) to run massive Monte Carlo campaigns. In order to handle these campaigns and to automatize simulation and data processing workflows, we have developed a production system prototype based on DIRAC. Recently, we have also developed a user interface allowing for the configuration and submission of complex workflows. In this contribution we present the production system prototype, its user interface for workflow management as well as its application to CTAO workflows.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Cherenkov Telescope Array Observatory sensitivity to heavy Galactic Cosmic Rays and the shape of particle spectrum
    Dubos, C.
    Sharma, P.
    Patel, S.
    Suomijaervi, T.
    JOURNAL OF COSMOLOGY AND ASTROPARTICLE PHYSICS, 2025, (02):
  • [42] Schwarzschild-Couder Telescope for the Cherenkov Telescope Array
    Meagher, Kevin J.
    GROUND-BASED AND AIRBORNE TELESCOPES V, 2014, 9145
  • [43] Prototype Schwarzschild-Couder Telescope for the Cherenkov Telescope Array: Commissioning the Optical System
    Ribeiro, Deivid
    37TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2021, 2022,
  • [44] The readout and control system of the mid-size telescope prototype of the Cherenkov Telescope Array
    Oya, I.
    Anguner, O.
    Behera, B.
    Birsin, E.
    Fuessling, M.
    Melkumyan, D.
    Schmidt, T.
    Schwanke, U.
    Sternberger, R.
    Wegner, P.
    Wiesand, S.
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [45] The GCT camera for the Cherenkov Telescope Array
    Lapington, J. S.
    Abchiche, A.
    Allan, D.
    Amans, J. -P.
    Armstrong, T. P.
    Balzer, A.
    Berge, D.
    Boisson, C.
    Bousquet, J. -J.
    Bose, R.
    Brown, A. M.
    Bryan, M.
    Buchholtz, G.
    Buckley, J.
    Chadwick, P. M.
    Costantini, H.
    Cotter, G.
    Daniel, M. K.
    De Franco, A.
    De Frondat, F.
    Dournaux, J. -L.
    Dumas, D.
    Ernenwein, J. -P.
    Fasola, G.
    Funk, S.
    Gironnet, J.
    Graham, J. A.
    Greenshaw, T.
    Hervet, O.
    Hidaka, N.
    Hinton, J. A.
    Huet, J. -M.
    Jankowsky, D.
    Jegouzo, I.
    Jogler, T.
    Kawashima, T.
    Kraus, M.
    Laporte, P.
    Leach, S.
    Lefaucheur, J.
    Markoff, S.
    Melse, T.
    Minaya, I. A.
    Mohrmann, L.
    Molyneux, P.
    Moore, P.
    Nolan, S. J.
    Okumura, A.
    Osborne, J. P.
    Parsons, R. D.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2017, 876 : 1 - 4
  • [46] An integrated workspace for the Cherenkov Telescope Array
    Costa, Alessandro
    Sciacca, Eva
    Vitello, Fabio
    Becciani, Ugo
    Massimino, Pietro
    Riggi, Simone
    Sanchez, David
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 94 : 811 - 819
  • [47] Status of the Cherenkov Telescope Array project
    Barres de Almeida, U.
    ASTRONOMISCHE NACHRICHTEN, 2015, 336 (8-9) : 795 - 799
  • [48] Structuring Metadata for the Cherenkov Telescope Array
    Servillat, Mathieu
    Boisson, Catherine
    Lefaucheur, Julien
    Bregeon, Johan
    Sanguillon, Michele
    Contreras, Jose-Luis
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXVI, 2019, 521 : 469 - 471
  • [49] Radio galaxies with the Cherenkov Telescope Array
    Angioni, R.
    Grandi, P.
    Torresi, E.
    Vignali, C.
    Knoedlseder, J.
    ASTROPARTICLE PHYSICS, 2017, 92 : 42 - 48
  • [50] Cherenkov Telescope Array (CTA) - challenges in systems engineering and project management
    Wild, Wolfgang
    Ansorge, Wolfgang
    MODELING, SYSTEMS ENGINEERING, AND PROJECT MANAGEMENT FOR ASTRONOMY VIII, 2018, 10705