The Data Ocean Project An ATLAS and Google R&D collaboration

被引:2
|
作者
Barisits, Martin [1 ]
Barreiro, Fernando [2 ]
Beermann, Thomas [3 ]
Bhatia, Karan [4 ]
De, Kaushik [2 ]
Dubreuil, Arnaud [5 ]
Elmsheuser, Johannes [6 ]
Klimentov, Alexei [6 ]
Lassnig, Mario [1 ]
Love, Peter [7 ]
Maeno, Tadashi [6 ]
Manzi, Andrea [1 ]
Mashinistov, Ruslan [6 ]
Murphy, Andy [4 ]
Nilsson, Paul [6 ]
Panitkin, Sergey [6 ]
Wegner, Tobias [1 ]
机构
[1] CERN, European Org Nucl Res, Geneva, Switzerland
[2] Univ Texas Arlington, Arlington, TX 76019 USA
[3] Univ Innsbruck, Innsbruck, Austria
[4] Google LLC, Mountain View, CA USA
[5] Univ Geneva, Geneva, Switzerland
[6] Brookhaven Natl Lab, Upton, NY 11973 USA
[7] Univ Lancaster, Lancaster, England
关键词
D O I
10.1051/epjconf/201921404020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transparent use of commercial cloud resources for scientific experiments is a hard problem. In this article, we describe the first steps of the Data Ocean R&D collaboration between the high-energy physics experiment ATLAS together with Google Cloud Platform, to allow seamless use of Google Compute Engine and Google Cloud Storage for physics analysis. We start by describing the three preliminary use cases that were identified at the beginning of the project. The following sections then detail the work done in the data management system Rucio and the workflow management systems PanDA and Harvester to interface Google Cloud Platform with the ATLAS distributed computing environment, and show the results of the integration tests. Afterwards, we describe the setup and results from a full ATLAS user analysis that was executed natively on Google Cloud Platform, and give estimates on projected costs. We close with a summary and and outlook on future work.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] A collaboration environment for R&D project
    Liao, August
    Fu, Li-Dien
    Chen, An-Pin
    [J]. COOPERATIVE DESIGN, VISUALIZATION, AND ENGINEERING, 2007, 4674 : 184 - +
  • [2] The ATLAS Planar Pixel Sensor R&D Project
    Beimforde, M.
    Muenstermann, D.
    [J]. 2009 IEEE NUCLEAR SCIENCE SYMPOSIUM CONFERENCE RECORD, VOLS 1-5, 2009, : 850 - +
  • [3] The ATLAS Planar Pixel Sensor R&D project
    Beimforde, M.
    [J]. NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2011, 636 : S8 - S14
  • [4] Expert Identification for Multidisciplinary R&D Project Collaboration
    Kongthon, Alisa
    Haruechaiyasak, Choochart
    Thaiprayoon, Santipong
    [J]. PROCEEDINGS OF PICMET 09 - TECHNOLOGY MANAGEMENT IN THE AGE OF FUNDAMENTAL CHANGE, VOLS 1-5, 2009, : 1431 - 1437
  • [5] Google R&D in Singapore?
    不详
    [J]. R&D MAGAZINE, 2007, 49 (03): : 18 - 18
  • [6] Google R&D in India
    不详
    [J]. R&D MAGAZINE, 2004, 46 (02): : 27 - 27
  • [7] The Role of Reputation Building in International R&D Project Collaboration
    J K Christiansen
    M T Vendelø
    [J]. Corporate Reputation Review, 2003, 5 (4) : 304 - 329
  • [8] R&D project selection versus R&D project generation
    Bordley, RF
    [J]. IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT, 1998, 45 (04) : 407 - 413
  • [9] Achievements of the ATLAS upgrade planar pixel sensors R&D project
    Calderini, G.
    [J]. NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 2014, 765 : 130 - 134
  • [10] ATLAS Cloud R&D
    Panitkin, Sergey
    Megino, Fernando Barreiro
    Bejar, Jose Caballero
    Benjamin, Doug
    Di Girolamo, Alessandro
    Gable, Ian
    Hendrix, Val
    Hover, John
    Kucharczyk, Katarzyna
    Llamas, Ramon Medrano
    Love, Peter
    Ohman, Henrik
    Paterson, Michael
    Sobie, Randall
    Taylor, Ryan
    Walker, Rodney
    Zaytsev, Alexander
    [J]. 20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513