The Data Ocean Project An ATLAS and Google R&D collaboration

被引:2
|
作者
Barisits, Martin [1 ]
Barreiro, Fernando [2 ]
Beermann, Thomas [3 ]
Bhatia, Karan [4 ]
De, Kaushik [2 ]
Dubreuil, Arnaud [5 ]
Elmsheuser, Johannes [6 ]
Klimentov, Alexei [6 ]
Lassnig, Mario [1 ]
Love, Peter [7 ]
Maeno, Tadashi [6 ]
Manzi, Andrea [1 ]
Mashinistov, Ruslan [6 ]
Murphy, Andy [4 ]
Nilsson, Paul [6 ]
Panitkin, Sergey [6 ]
Wegner, Tobias [1 ]
机构
[1] CERN, European Org Nucl Res, Geneva, Switzerland
[2] Univ Texas Arlington, Arlington, TX 76019 USA
[3] Univ Innsbruck, Innsbruck, Austria
[4] Google LLC, Mountain View, CA USA
[5] Univ Geneva, Geneva, Switzerland
[6] Brookhaven Natl Lab, Upton, NY 11973 USA
[7] Univ Lancaster, Lancaster, England
关键词
D O I
10.1051/epjconf/201921404020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Transparent use of commercial cloud resources for scientific experiments is a hard problem. In this article, we describe the first steps of the Data Ocean R&D collaboration between the high-energy physics experiment ATLAS together with Google Cloud Platform, to allow seamless use of Google Compute Engine and Google Cloud Storage for physics analysis. We start by describing the three preliminary use cases that were identified at the beginning of the project. The following sections then detail the work done in the data management system Rucio and the workflow management systems PanDA and Harvester to interface Google Cloud Platform with the ATLAS distributed computing environment, and show the results of the integration tests. Afterwards, we describe the setup and results from a full ATLAS user analysis that was executed natively on Google Cloud Platform, and give estimates on projected costs. We close with a summary and and outlook on future work.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Partners sought for R&D collaboration
    不详
    [J]. CHEMICAL ENGINEERING, 2004, 111 (12) : 8 - 8
  • [32] Formal R&D Management and Research Collaboration and R&D Outsourcing in SMEs
    Teirlinck, Peter
    Spithoven, Andre
    [J]. PROCEEDINGS OF THE 6TH EUROPEAN CONFERENCE ON INNOVATION AND ENTREPRENEURSHIP, VOL 1 AND 2, 2011, : 820 - 826
  • [33] R&D collaboration around the world
    Reklaitis, GV
    [J]. CHEMTECH, 1997, 27 (05) : 10 - 15
  • [34] Collaboration to push maritime R&D
    不详
    [J]. NAVAL ARCHITECT, 2006, : B20 - B20
  • [35] Knowledge specialization and R&D collaboration
    Caminati, Mauro
    [J]. JOURNAL OF EVOLUTIONARY ECONOMICS, 2016, 26 (02) : 247 - 270
  • [36] RWE AND BRAIN IN R&D COLLABORATION
    不详
    [J]. CHEMICAL & ENGINEERING NEWS, 2010, 88 (02) : 21 - 21
  • [37] International R&D collaboration networks
    Song, Huasheng
    Vannetelbosch, Vincent
    [J]. MANCHESTER SCHOOL, 2007, 75 (06): : 742 - 766
  • [38] Call for R&D project descriptions - R&D abstract database
    不详
    [J]. SPILL SCIENCE & TECHNOLOGY BULLETIN, 1995, 2 (04) : 217 - 221
  • [39] Open Innovation, R&D Collaboration and Global Strategy in Hightech SMEs: Focused on R&D Collaboration Mode
    Jeon, Rara
    Dagravel, Daniel
    [J]. PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON INNOVATION AND ENTREPRENEURSHIP (ICIE 2017), 2017, : 52 - 60
  • [40] Relationship between R&D subsidies and R&D collaboration in promoting firm innovation
    Dong, Huiping
    Guo, Yating
    Shi, Xing
    Du, Shaofu
    [J]. JOURNAL OF TECHNOLOGY TRANSFER, 2024,