Dynamic Virtualized Deployment of Particle Physics Environments on a High Performance Computing Cluster

被引:0
|
作者
Bührer F. [1 ]
Fischer F. [4 ]
Fleig G. [4 ]
Gamel A. [1 ,3 ]
Giffels M. [4 ]
Hauth T. [4 ]
Janczyk M. [3 ]
Meier K. [3 ]
Quast G. [4 ]
Roland B. [1 ]
Schnoor U. [1 ,2 ]
Schumacher M. [1 ]
von Suchodoletz D. [3 ]
Wiebelt B. [3 ]
机构
[1] Universität Freiburg, Physikalisches Institut, Hermann-Herder-Str. 3, Freiburg
[2] CERN, Geneva 23
[3] Universität Freiburg, Rechenzentrum, Hermann-Herder-Str.10, Freiburg
[4] Karlsruher Institut für Technologie, Institut für Experimentelle Teilchenphysik, Wolfgang-Gaede-Str. 1, Karlsruhe
关键词
Benchmarks; Grid computing; Opportunistic usage; Particle physics; Virtualization;
D O I
10.1007/s41781-019-0024-5
中图分类号
学科分类号
摘要
A setup for dynamically providing resources of an external, non-dedicated cluster to researchers of the ATLAS and CMS experiments in the WLCG environment is described as it has been realized at the NEMO High Performance Computing cluster at the University of Freiburg. Techniques to provide the full WLCG software environment in a virtual machine image are described. The interplay between the schedulers for NEMO and for the external clusters is coordinated through the ROCED service. A cloud computing infrastructure is deployed at NEMO to orchestrate the simultaneous usage by bare metal and virtualized jobs. Through the setup, resources are provided to users in a transparent, automatized, and on-demand way. The performance of the virtualized environment has been evaluated for particle physics applications. © 2019, Springer Nature Switzerland AG.
引用
收藏
相关论文
共 50 条
  • [1] Virtualized environments for the harness high performance computing workbench
    Koenning, B.
    Engelmann, C.
    Scott, S. L.
    Geist, G. A.
    [J]. PROCEEDINGS OF THE 16TH EUROMICRO CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, 2008, : 133 - 140
  • [2] Multiverse: Dynamic VM Provisioning for Virtualized High Performance Computing Clusters
    Gunasekaran, Jashwant Raj
    Cui, Michael
    Thinakaran, Prashanth
    Simons, Josh
    Kandemir, Mahmut T.
    Das, Chita R.
    [J]. 2020 20TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2020), 2020, : 131 - 141
  • [3] Performance Analysis of Algorithms for Virtualized Environments on Cloud Computing
    Boaventura, R. S.
    Yamanaka, K.
    Oliveira, G. P.
    [J]. IEEE LATIN AMERICA TRANSACTIONS, 2014, 12 (04) : 792 - 797
  • [4] Dynamic task scheduling in computing cluster environments
    Savvas, IK
    Kechadi, MT
    [J]. ISPDC 2004: THIRD INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING/HETEROPAR '04: THIRD INTERNATIONAL WORKSHOP ON ALGORITHMS, MODELS AND TOOLS FOR PARALLEL COMPUTING ON HETEROGENEOUS NETWORKS, PROCEEDINGS, 2004, : 372 - 379
  • [5] Performance Study of Multi-access Edge Computing Deployment in a Virtualized Environment
    Tambe, Supriya Dilip
    Mandge, Yogesh
    Franklin, Antony A.
    [J]. 2020 IEEE 3RD 5G WORLD FORUM (5GWF), 2020, : 424 - 429
  • [6] Power and performance management of virtualized computing environments via lookahead control
    Kusic, Dara
    Kephart, Jeffrey O.
    Hanson, James E.
    Kandasamy, Nagarajan
    Jiang, Guofei
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2009, 12 (01): : 1 - 15
  • [7] Power and performance management of virtualized computing environments via lookahead control
    Dara Kusic
    Jeffrey O. Kephart
    James E. Hanson
    Nagarajan Kandasamy
    Guofei Jiang
    [J]. Cluster Computing, 2009, 12 : 1 - 15
  • [8] Deployment of parallel computing in a hybrid high-performance cluster based on virtualization technologies
    Volovich, K., I
    Denisov, S. A.
    Malkovsky, S., I
    [J]. 14TH INTERNATIONAL SYMPOSIUM INTELLIGENT SYSTEMS, 2021, 186 : 40 - 47
  • [9] Performance management in dynamic computing environments
    Kotsis, G
    [J]. PERFORMANCE TOOLS AND APPLICATIONS TO NETWORKED SYSTEMS, 2004, 2965 : 254 - 264
  • [10] EXPLORING THE PHYSICS OF DYNAMIC FRAGMENTATION THROUGH HIGH-PERFORMANCE COMPUTING
    Levy, S.
    Molinari, J. F.
    Radovitzky, R.
    [J]. ADVANCES IN HETEROGENEOUS MATERIAL MECHANICS 2011, 2011, : 996 - 996