The Cherenkov Telescope Array Observatory workflow management system

被引:0
|
作者
Arrabito, Luisa [1 ]
Bregeon, Johan [2 ]
Faure, Alice [1 ]
Gueta, Orel [3 ]
Pigoux, Natthan [1 ]
Tsaregorodtsev, Andrei [4 ]
机构
[1] CNRS, IN2P3, Lab Univers & Particules Montpellier, Montpellier, France
[2] CNRS, IN2P3, Lab Phys Subatom & Cosmol, Grenoble, France
[3] Deutsch Elektronen Synchrotron DESY, Platanenallee 6, Zeuthen, Germany
[4] Aix Marseille Univ, CNRS, IN2P3, CPPM, Marseille, France
关键词
D O I
10.1051/epjconf/202429504044
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Cherenkov Telescope Array Observatory (CTAO) is the next generation ground-based observatory for gamma-ray astronomy at very high energies. It is expected to produce about 2 PB of raw data each year and to manage a global data volume which will grow through the years to reach about 100 PB in 2030. In addition, CTAO will require a high computing capacity for data processing and Monte Carlo simulations, of the order of hundreds of millions of CPU HS06 hours per year. To meet these requirements, CTAO will adopt a distributed computing model using 4 academic data centers, and will use the DIRAC framework as its workload management system. In the past ten years, to optimize the instrument design and study its performances, CTAO has used the European Grid Infrastructure (EGI) to run massive Monte Carlo campaigns. In order to handle these campaigns and to automatize simulation and data processing workflows, we have developed a production system prototype based on DIRAC. Recently, we have also developed a user interface allowing for the configuration and submission of complex workflows. In this contribution we present the production system prototype, its user interface for workflow management as well as its application to CTAO workflows.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] The Transients Handler System for the Cherenkov Telescope Array Observatory
    Egberts, Kathrin
    Hoischen, Clemens
    Steppa, Constantin
    Fuessling, Matthias
    Neise, Dominik
    Wilhelmi, Emma de Ona
    Oya, Igor
    OBSERVATORY OPERATIONS: STRATEGIES, PROCESSES, AND SYSTEMS IX, 2022, 12186
  • [2] The Science Alert Generation system of the Cherenkov Telescope Array Observatory
    Bulgarelli, A.
    Caroff, S.
    Castaldini, L.
    Aubert, P.
    De Cesare, G.
    Di Piano, A.
    Fioretti, V
    Maurin, G.
    Panebianco, G.
    Parmiggiani, N.
    Pollet, Vincent
    Vuillaume, T.
    Oya, I
    Steppa, C.
    Egberts, K.
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VIII, 2024, 13101
  • [3] The Science Alert Generation system of the Cherenkov Telescope Array Observatory
    Bulgarelli, A.
    Caroff, S.
    Addis, A.
    Aubert, P.
    Baroncelli, L.
    De Cesare, G.
    Di Piano, A.
    Fioretti, V.
    Garcia, E.
    Maurin, G.
    Parmiggiani, N.
    Vuillaume, T.
    Oya, I.
    Hoischen, C.
    37TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2021, 2022,
  • [4] The comprehensive monitoring, logging, and alarm system for the Cherenkov Telescope Array Observatory
    Costa, Alessandro
    Munari, Kevin
    Incardona, Federico
    Germani, Stefano
    Bruno, Pietro
    Mastriani, Emilio
    Spinello, Sebastiano
    Oya, Igor
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VIII, 2024, 13101
  • [5] Updates on the Transients Handler of the Cherenkov Telescope Array Observatory
    Steppa, Constantin
    Collins, Tiffany
    Egberts, Kathrin
    Hoischen, Clemens
    Neise, Dominik
    Wilhelmi, Emma de Ona
    Oya, Igor
    Sarkar, Arkadipta
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VIII, 2024, 13101
  • [6] The next generation Cherenkov Telescope Array observatory: CTA
    Vercellone, S.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2014, 766 : 73 - 77
  • [7] Performance of the small size telescope sub-array of the Cherenkov Telescope Array observatory
    Moderski, R.
    Aguilar, J. A.
    Bilnik, W.
    Bogacz, L.
    Bulik, T.
    Christov, A.
    della Volpe, D.
    Dyrda, Mi.
    Frankowski, A.
    Grudziiiska, M.
    Grygorczuk, J.
    Heller, Mi.
    Idikowskib, B.
    Janiake, Mi.
    Jamrozy, Mi.
    Karczewski, Mi.
    Kaspereke, J.
    Lyard, E.
    Marszalek, A.
    Michalowsk, J.
    Mohamed, R.
    Montaruli, T.
    Neronov, A.
    Nicolau-Kuklifisk, J.
    Niemiec, J.
    Ostrowski, M.
    Pagko, P.
    Platos, L.
    Prandini, E.
    Pruchniewicz, R.
    Rafalski, J.
    Rajda, P. J.
    Rataj, Mi.
    Rupiniski, Mi.
    Rutkowski, K.
    Seweryn, K.
    Sidz, Mi.
    Stawarz, L.
    Wawer, P.
    Wawrzaszek, R.
    Wigniewski, L.
    Zietara, K.
    Zikowski, P.
    Zychowski, P.
    GROUND-BASED AND AIRBORNE TELESCOPES V, 2014, 9145
  • [8] Methodology for the Integration of the Array Control and Data Acquisition System with Array Elements of the Cherenkov Telescope Array Observatory
    Lopez, B.
    Aubert, P.
    Baroncelli, L.
    Bolle, P.
    Bruno, P.
    Bulgarelli, A.
    Caroff, S.
    Castaldini, L.
    Conforti, V
    Costa, A.
    David, L.
    De Cesare, G.
    Wilhelmi, E. de Ona
    Di Piano, A.
    Egberts, K.
    Fernandez, R.
    Fioretti, V
    Fukami, S.
    Garcia, E.
    Gasparyan, H.
    Germani, S.
    Incardona, F.
    Kostunin, D.
    Lyard, E.
    Maurin, G.
    Melkumyan, D.
    Munari, K.
    Murach, T.
    Muraczewski, A.
    Nakhjiri, N.
    Neise, D.
    Oya, I
    Panebianco, G.
    Parmiggiani, N.
    Pollet, V
    Sadeh, I
    Sah, S.
    Sarkar, A.
    Schefer, M.
    Schmidt, T.
    Soldevila, D.
    Steppa, C.
    Tramacere, A.
    Valles, R.
    Vuillaume, T.
    Werner, F.
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VIII, 2024, 13101
  • [9] Development of the quality control system of the readout electronics for the large size telescope of the Cherenkov Telescope Array observatory
    Konno, Y.
    Kubo, H.
    Masuda, S.
    Paoletti, R.
    Poulios, S.
    Rugliancich, A.
    Saito, T.
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2016, 824 : 349 - 352
  • [10] The Camera Calibration System for the first Large-Sized Telescope designed for the Cherenkov Telescope Array Observatory
    Palatiello, Michele
    Iori, Maurizio
    Cauz, Diego
    ADVANCES IN OPTICAL AND MECHANICAL TECHNOLOGIES FOR TELESCOPES AND INSTRUMENTATION V, 2022, 12188