Towards an Intelligent Data Delivery Service

被引:1
|
作者
Guan, Wen [1 ]
Maeno, Tadashi [2 ]
Dimitrov, Gancho [3 ]
Bockelman, Brian Paul [4 ]
Wenaus, Torre [2 ]
Tsulaia, Vakhtang [5 ]
Magini, Nicolo [6 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Brookhaven Natl Lab, Upton, NY 11973 USA
[3] CERN, Meyrin, Switzerland
[4] Univ Nebraska Lincoln, Lincoln, NE USA
[5] Lawrence Berkeley Natl Lab, Berkeley, CA USA
[6] Iowa State Univ, Ames, IA USA
关键词
D O I
10.1051/epjconf/202024504015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.
引用
收藏
页数:6
相关论文
共 50 条
  • [11] How intelligent automation, service robots, and AI will reshape service products and their delivery
    Jochen Wirtz
    Valentina Pitardi
    Italian Journal of Marketing, 2023, 2023 (3) : 289 - 300
  • [12] Testing OGC Web Feature and Coverage Service performance: Towards efficient delivery of geospatial data
    Giuliani, Gregory
    Dubois, Alan
    Lacroix, Pierre
    JOURNAL OF SPATIAL INFORMATION SCIENCE, 2013, (07): : 1 - 23
  • [13] Towards a Multi-Channel Service Delivery model in the data-driven puulic sector
    Agbozo, Ebenezer
    Medvedev, Alexander N.
    BIZNES INFORMATIKA-BUSINESS INFORMATICS, 2020, 14 (01): : 41 - 50
  • [14] Big Data Service Delivery Network
    E, Xinhua
    Zhu, Binjie
    ICOMS 2018: 2018 INTERNATIONAL CONFERENCE ON MATHEMATICS AND STATISTICS, 2018, : 89 - 91
  • [15] Website Intelligent Service Based on Data Mining
    Liu, Yong
    PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE OF MANAGEMENT ENGINEERING AND INFORMATION TECHNOLOGY, VOLS 1 AND 2, 2009, : 115 - 118
  • [16] Intelligent visual data analysis service in the internet
    Natalia, A
    Gennady, A
    SECOND INTERNATIONAL CONFERENCE ON WEB INFORMATION SYSTEMS ENGINEERING, VOL 2, PROCEEDINGS, 2002, : 85 - 91
  • [17] Towards Intelligent Data Analysis: The Metadata Challenge
    Bilalli, Besim
    Abello, Alberto
    Aluja-Banet, Tomas
    Wrembel, Robert
    IOTBD: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS AND BIG DATA, 2016, : 331 - 338
  • [18] Data lifecycles analysis: towards intelligent cycle
    El Arass, M.
    Tikito, I.
    Souissi, N.
    2017 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2017,
  • [19] THE EVOLUTION OF NETWORK SERVICE - MOVING TOWARDS AN INTELLIGENT NETWORK ERA
    ISHIKAWA, H
    ISHIKAWA, H
    NTT REVIEW, 1990, 2 (02): : 18 - 23
  • [20] Towards building intelligent transportation information service system on grid
    Li, Y
    Li, ML
    Cao, J
    Wu, XH
    Huang, LP
    Rao, RN
    Lin, XH
    Jiang, CJ
    Wu, MY
    ADVANCED WEB AND NETWORK TECHNOLOGIES, AND APPLICATIONS, PROCEEDINGS, 2006, 3842 : 632 - 642