Mastering Opportunistic Computing Resources for HEP

被引:1
|
作者
Schnepf, M. J. [1 ]
Heidecker, C. [1 ]
Fischer, M. [1 ]
Giffels, M. [1 ]
Kuehn, E. [1 ]
Heiss, A. [1 ]
Petzold, A. [1 ]
Quast, G. [1 ]
机构
[1] KIT, Karlsruhe, Germany
关键词
D O I
10.1088/1742-6596/1085/3/032056
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
As results of the excellent LHC performance in 2016, more data than expected has been recorded leading to a higher demand for computing resources. It is already foreseeable that for the current and upcoming run periods a flat computing budget and the expected technology advance will not be sufficient to meet the future requirements. This results in a growing gap between supplied and demanded resources. One option to reduce the emerging lack of computing resources is the utilization of opportunistic resources such as local university clusters, public and commercial cloud providers, HPC centers and volunteer computing. However, to use opportunistic resources additional challenges have to be tackled. At the Karlsruhe Institute of Technology ( KIT) an infrastructure to dynamically use opportunistic resources is built up. In this paper tools, experiences, future plans and possible improvements are discussed.
引用
下载
收藏
页数:6
相关论文
共 50 条
  • [1] HEP Analyses on Dynamically Allocated Opportunistic Computing Resources
    Schnepf, M. J.
    von Cube, R. F.
    Heidecker, C.
    Fischer, M.
    Giffels, M.
    Kuehn, E.
    Heiss, A.
    Petzold, A.
    Quast, G.
    Sauter, M.
    19TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, 2020, 1525
  • [2] Dynamic Integration and Management of Opportunistic Resources for HEP
    Schnepf, Matthias J.
    von Cube, R. Florian
    Fischer, Max
    Giffels, Manuel
    Heidecker, Christoph
    Heiss, Andreas
    Kuehn, Eileen
    Petzold, Andreas
    Quast, Guenter
    Sauter, Martin
    23RD INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2018), 2019, 214
  • [3] Reliable MapReduce computing on opportunistic resources
    Lin, Heshan
    Ma, Xiaosong
    Feng, Wu-chun
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2012, 15 (02): : 145 - 161
  • [4] Reliable MapReduce computing on opportunistic resources
    Heshan Lin
    Xiaosong Ma
    Wu-chun Feng
    Cluster Computing, 2012, 15 : 145 - 161
  • [5] Exploiting volatile opportunistic computing resources with Lobster
    Woodard, Anna
    Wolf, Matthias
    Mueller, Charles
    Tovar, Ben
    Donnelly, Patrick
    Anampa, Kenyi Hurtado
    Brenner, Paul
    Lannon, Kevin
    Hildreth, Mike
    Thain, Douglas
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [6] Enabling opportunistic resources for CMS Computing Operations
    Hufnagel, Dirk
    21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9, 2015, 664
  • [7] Predicting resource usage for enhanced job scheduling for opportunistic resources in HEP
    Kuehn, Eileen
    Fischer, Max
    Lange, Sven
    Petzold, Andreas
    Heiss, Andreas
    24TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2019), 2020, 245
  • [8] Lightweight Integration of a Data Cache for Opportunistic Usage of HPC Resources in HEP Workflows
    Sammel D.
    Boehler M.
    Gamel A.J.
    Schumacher M.
    Computing and Software for Big Science, 2023, 7 (1)
  • [9] Financial Case Study on the Use of Cloud Resources in HEP Computing
    Misawa, Shigeki
    Hollowell, Christopher
    Lauret, Jerome
    Rao, Tejas
    Zaytsev, Alexandr
    26TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS, CHEP 2023, 2024, 295
  • [10] Using HEP experiment workflows for the benchmarking and accounting of WLCG computing resources
    Valassi, Andrea
    Alef, Manfred
    Barbet, Jean-Michel
    Datskova, Olga
    De Maria, Riccardo
    Medeiros, Miguel Fontes
    Giordano, Domenico
    Grigoras, Costin
    Hollowell, Christopher
    Javurkova, Martina
    Khristenko, Viktor
    Lange, David
    Michelotto, Michele
    Rinaldi, Lorenzo
    Sciaba, Andrea
    Van Der Laan, Cas
    24TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP 2019), 2020, 245