The Cherenkov Telescope Array Observatory workflow management system

被引:0
|
作者
Arrabito, Luisa [1 ]
Bregeon, Johan [2 ]
Faure, Alice [1 ]
Gueta, Orel [3 ]
Pigoux, Natthan [1 ]
Tsaregorodtsev, Andrei [4 ]
机构
[1] CNRS, IN2P3, Lab Univers & Particules Montpellier, Montpellier, France
[2] CNRS, IN2P3, Lab Phys Subatom & Cosmol, Grenoble, France
[3] Deutsch Elektronen Synchrotron DESY, Platanenallee 6, Zeuthen, Germany
[4] Aix Marseille Univ, CNRS, IN2P3, CPPM, Marseille, France
关键词
D O I
10.1051/epjconf/202429504044
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The Cherenkov Telescope Array Observatory (CTAO) is the next generation ground-based observatory for gamma-ray astronomy at very high energies. It is expected to produce about 2 PB of raw data each year and to manage a global data volume which will grow through the years to reach about 100 PB in 2030. In addition, CTAO will require a high computing capacity for data processing and Monte Carlo simulations, of the order of hundreds of millions of CPU HS06 hours per year. To meet these requirements, CTAO will adopt a distributed computing model using 4 academic data centers, and will use the DIRAC framework as its workload management system. In the past ten years, to optimize the instrument design and study its performances, CTAO has used the European Grid Infrastructure (EGI) to run massive Monte Carlo campaigns. In order to handle these campaigns and to automatize simulation and data processing workflows, we have developed a production system prototype based on DIRAC. Recently, we have also developed a user interface allowing for the configuration and submission of complex workflows. In this contribution we present the production system prototype, its user interface for workflow management as well as its application to CTAO workflows.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Development and operations of INFN optical modules for the SCT Telescope camera proposed for the Cherenkov Telescope Array Observatory
    Adams, C.
    Ambrosi, G.
    Ambrosio, M.
    Aramo, C.
    Benbow, W.
    Bertucci, B.
    Bissaldi, E.
    Bitossi, M.
    Boiano, A.
    Bonavolonta, C.
    Bose, R.
    Brill, A.
    Buckley, J. H.
    Caprai, M.
    Covault, C. E.
    Di Venere, L.
    Feng, Q.
    Fiandrini, E.
    Gent, A.
    Giglietto, N.
    Giordano, F.
    Halliday, R.
    Hervet, O.
    Hughes, G.
    Humensky, T. B.
    Ionica, M.
    Jin, W.
    Kaaret, P.
    Kieda, D.
    Kim, B.
    Licciulli, F.
    Loporchio, S.
    Masone, V.
    Meures, T.
    Mode, B. A. W.
    Mukherjee, R.
    Okumura, A.
    Otte, N.
    Pantaleo, F. R.
    Paoletti, R.
    Petrashyk, A.
    Powell, J.
    Powell, K.
    Ribeiro, D.
    Rugliancich, A.
    Santander, M.
    Shang, R.
    Stevenson, B.
    Stiaccini, L.
    Taylor, L. P.
    36TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2019, 2021,
  • [22] The Monitoring, Logging, and Alarm system for the Cherenkov Telescope Array
    Costa, Alessandro
    Munari, Kevin
    Incardona, Federico
    Bruno, Pietro
    Germani, Stefano
    Grillo, Alessandro
    Oya, Igor
    Sciacca, Eva
    Becciani, Ugo
    Raciti, Mario
    37TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2021, 2022,
  • [23] Designing and prototyping the control system for the Cherenkov Telescope Array
    Oya, I.
    Fuessling, M.
    Antonino, P. O.
    Araya, M.
    Borkowski, J.
    Bulgarelli, A.
    Castroviejo, J.
    Colome, J.
    Conforti, V.
    Garcia-Piquer, A.
    Guardia, J.
    Hagge, L.
    Lyard, E.
    Morgenstern, A.
    Mayer, M.
    Melkumyan, D.
    Murach, T.
    Pizarro, L.
    Sadeh, I.
    Schmidt, T.
    Schwanke, U.
    Spengler, G.
    Schwarz, J.
    Tosti, G.
    Walter, R.
    Wegner, P.
    18TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH (ACAT2017), 2018, 1085
  • [24] Prototyping the central control system for the Cherenkov Telescope Array
    Melkumyan, D.
    Oya, I
    Bobnar, J.
    Sah, S.
    Anutarawiramkul, R.
    Fuessling, M.
    Sadeh, I
    Sekoranja, M.
    Schmidt, T.
    Schwanke, U.
    Schwarz, J.
    Spengler, G.
    Wegner, P.
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY V, 2018, 10707
  • [25] Prototype of a production system for Cherenkov Telescope Array with DIRAC
    Arrabito, L.
    Bregeon, J.
    Haupt, A.
    Graciani Diaz, R.
    Stagni, F.
    Tsaregorodtsev, A.
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [26] The Software Version Control Procedure for the Array Control and Data Acquisition Software of the Cherenkov Telescope Array Observatory
    Conforti, V
    Gasparyan, H.
    Lopez, B.
    Neise, D.
    Oya, I
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VIII, 2024, 13101
  • [27] Status of the array control and data acquisition system for the Cherenkov Telescope Array
    Fuessling, Matthias
    Oya, Igor
    Balzer, Arnim
    Berge, David
    Borkowski, Jerzy
    Conforti, Vito
    Colome, Josep
    Lindemann, Rico
    Lyard, Etienne
    Melkumyan, David
    Punch, Michael
    Schwanke, Ullrich
    Schwarz, Joseph
    Tanci, Claudio
    Tosti, Gino
    Wegner, Peter
    Wischnewski, Ralf
    Weinstein, Amanda
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY IV, 2016, 9913
  • [28] Outreach for Science Facilities: Armagh Observatory and Planetarium's programme for the Cherenkov Telescope Array
    Burton, Michael G.
    Cubuk, Kerem Osman
    Alexander, Heather
    37TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2021, 2022,
  • [29] Cherenkov Telescope Array: the World's largest VHE gamma-ray observatory
    Zanin, Roberta
    37TH INTERNATIONAL COSMIC RAY CONFERENCE, ICRC2021, 2022,
  • [30] Multi-wavelength scanning Raman lidar simulations for the Cherenkov Telescope Array observatory
    Pallotta, Juan V.
    Ristori, Pablo R.
    Otero, Lidia A.
    Etchegoyen, Alberto
    Quel, Eduardo
    OPTICA PURA Y APLICADA, 2014, 47 (02): : 91 - 97