Running ALICE Grid Jobs in Containers A new approach to job execution for the next generation ALICE Grid framework

被引:2
|
作者
Storetvedt, Maxim [1 ]
Betev, Latchezar [2 ]
Helstrup, Havard [1 ]
Hetland, Kristin Fanebust [1 ]
Kileng, Bjarte [1 ]
机构
[1] Western Norway Univ Appl Sci, Fac Engn & Sci, Bergen, Norway
[2] CERN, Geneva, Switzerland
关键词
D O I
10.1051/epjconf/202024507052
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The new JAliEn (Java ALICE Environment) middleware is a Grid framework designed to satisfy the needs of the ALICE experiment for the LHC Run 3, such as providing a high-performance and high-scalability service to cope with the increased volumes of collected data. This new framework also introduces a split, two-layered job pilot, creating a new approach to how jobs are handled and executed within the Grid. Each layer runs on a separate JVM, with a separate authentication token, allowing for a finer control of permissions and improved isolation of the payload. Having these separate layers also allows for the execution of job payloads within containers. This allows for the further strengthening of isolation and creates a cohesive environment across computing sites, while avoiding the resource overhead associated with traditional virtualisation. This contribution presents the architecture of the new split job pilot found in JAliEn, and the methods used to achieve the execution of Grid jobs while maintaining reliable communication between layers. Specifically, how this is achieved despite the possibility of a layer being run in a separate container, while retaining isolation and mitigating possible security risks. Furthermore, we discuss how the implementation remains agnostic to the choice of container platform, allowing it to run within popular platforms such as Singularity and Docker.
引用
收藏
页数:6
相关论文
共 35 条
  • [1] The Security model of the ALICE next generation Grid framework
    Pedreira, Miguel Martinez
    Grigoras, Costin
    Yurchenko, Volodymyr
    Storetvedt, Maksim Melnik
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [2] Job splitting on the ALICE grid, introducing the new job optimizer for the ALICE grid middleware
    Reme-Ness, Haakon Andre
    Grigoras, Costin
    Helstrup, Havard
    Kileng, Bjarte
    Storetvedt, Maksim
    Betev, Latchezar
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [3] Modelling the Next Generation ALICE Grid Middleware Using Coloured Petri Nets
    Storetvedt, Maxim
    Betev, Latchezar
    Hardi, Nikola
    Helstrup, Havard
    Hetland, Kristin Fanebust
    Kileng, Bjarte
    APPLICATION AND THEORY OF PETRI NETS AND CONCURRENCY (PETRI NETS 2022), 2022, 13288 : 195 - 210
  • [4] Mediated definite delegation - Certified Grid jobs in ALICE and beyond
    Schreiner, Steffen
    Grigoras, Costin
    Litmaath, Maarten
    Betev, Latchezar
    Buchmann, Johannes
    INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS 2012 (CHEP2012), PTS 1-6, 2012, 396
  • [5] Multicore workflow characterisation methodology for payloads running in the ALICE Grid
    Ferrer, Marta Bertran
    Grigoras, Costin
    Badia, Rosa M.
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [6] Interactive Parallel Analysis on the ALICE Grid with the PROOF Framework
    Meoni, Marco
    COMPUTATIONAL SCIENCE - ICCS 2009, PART I, 2009, 5544 : 114 - 122
  • [7] Exploring virtualisation tools with a new virtualisation provisioning method to test dynamic grid environments for ALICE grid jobs over ARC grid middleware
    Wagner, B.
    Kileng, B.
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [8] The Grid Ka Tier-1 Computing Center within the ALICE Grid Framework
    Park, WooJin J.
    Christopher, Jung
    Heiss, Andreas
    Petzold, Andreas
    Schwarz, Kilian
    20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [9] JAIiEn: the new ALICE high-performance and high-scalability Grid framework
    Pedreira, M. Martinez
    Grigoras, C.
    Yurchenko, V
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [10] MCCF: A distributed grid job workflow execution framework
    Feng, Yuhong
    Cai, Wentong
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2004, 3358 : 274 - 279