Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster

被引:0
|
作者
Bührer F. [1 ]
Fischer F. [4 ]
Fleig G. [4 ]
Gamel A. [1 ,3 ]
Giffels M. [4 ]
Hauth T. [4 ]
Janczyk M. [3 ]
Meier K. [3 ]
Quast G. [4 ]
Roland B. [1 ]
Schnoor U. [1 ,2 ]
Schumacher M. [1 ]
von Suchodoletz D. [3 ]
Wiebelt B. [3 ]
机构
[1] Universität Freiburg, Physikalisches Institut, Hermann-Herder-Str. 3, Freiburg
[2] CERN, Geneva 23
[3] Universität Freiburg, Rechenzentrum, Hermann-Herder-Str.10, Freiburg
[4] Karlsruher Institut für Technologie, Institut für Experimentelle Teilchenphysik, Wolfgang-Gaede-Str. 1, Karlsruhe
关键词
Benchmarks; Grid computing; Opportunistic usage; Particle physics; Virtualization;
D O I
10.1007/s41781-019-0024-5
中图分类号
学科分类号
摘要
A setup for dynamically providing resources of an external, non-dedicated cluster to researchers of the ATLAS and CMS experiments in the WLCG environment is described as it has been realized at the NEMO High Performance Computing cluster at the University of Freiburg. Techniques to provide the full WLCG software environment in a virtual machine image are described. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications. © 2019, Springer Nature Switzerland AG.
引用
收藏
相关论文
共 50 条
  • [31] HIGH-PERFORMANCE COMPUTING SYSTEM FOR HIGH ENERGY PHYSICS
    Orlandea, M.
    Coca, C.
    Dumitru, L.
    Teodorescu, E.
    [J]. ROMANIAN JOURNAL OF PHYSICS, 2011, 56 (3-4): : 359 - 365
  • [32] Xen2MX: High-performance communication in virtualized environments
    Nanos, Anastassios
    Koziris, Nectarios
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2014, 95 : 217 - 230
  • [33] SCTP, XTP and TCP as Transport Protocols for High Performance Computing on Multi-cluster Grid Environments
    Viegas, Diogo R.
    Mendonca, R. P.
    Dantas, Mario A. R.
    Bauer, Michael A.
    [J]. HIGH PERFORMANCE COMPUTING SYSTEMS AND APPLICATIONS, 2010, 5976 : 230 - +
  • [34] Computing for Ongoing Experiments on High-Energy Physics at Laboratory of Particle Physics at JINR
    Belosludtsev, D. A.
    Zhil'tsov, V. E.
    Zinchenko, A. I.
    Kekelidze, V. D.
    Madigozhin, D. T.
    Potrebenikov, Yu. K.
    Khabarov, S. V.
    Shkarovsky, S. N.
    Shchinov, B. G.
    [J]. PHYSICS OF PARTICLES AND NUCLEI LETTERS, 2006, 3 (04) : 229 - 233
  • [35] On Performance Study of The Global Arrays Toolkit on Cluster and Grid Computing Environments
    Sirisup, Sirod
    U-ruekolan, Suriya
    [J]. ECTI-CON 2008: PROCEEDINGS OF THE 2008 5TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2008, : 141 - 144
  • [36] Design and Performance Measurement of a High-Performance Computing Cluster
    George, Kiran
    Venugopal, Vivek
    [J]. 2012 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2012, : 2531 - 2536
  • [37] Special Topic on High Performance Computing in Chemical Physics
    Straatsma, Tjerk P.
    Windus, Theresa L.
    Nakajima, Takahito
    [J]. JOURNAL OF CHEMICAL PHYSICS, 2023, 159 (21):
  • [38] Special Topic on High Performance Computing in Chemical Physics
    Straatsma, Tjerk P.
    Windus, Theresa L.
    Nakajima, Takahito
    [J]. Journal of Chemical Physics, 2023, 159 (21):
  • [39] Integrating High Performance Computing into Higher Education and the Pedagogy of Cluster Computing
    Stevens, Cody
    Anderson, Sean M.
    Carlson, Adam
    [J]. PRACTICE AND EXPERIENCE IN ADVANCED RESEARCH COMPUTING 2024, PEARC 2024, 2024,
  • [40] FAIRNESS OF TASK SCHEDULING IN HIGH PERFORMANCE COMPUTING ENVIRONMENTS
    Sedighi, Art
    Deng, Yuefan
    Zhang, Peng
    [J]. SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2014, 15 (03): : 273 - 288