Towards an Intelligent Data Delivery Service

被引:1
|
作者
Guan, Wen [1 ]
Maeno, Tadashi [2 ]
Dimitrov, Gancho [3 ]
Bockelman, Brian Paul [4 ]
Wenaus, Torre [2 ]
Tsulaia, Vakhtang [5 ]
Magini, Nicolo [6 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Brookhaven Natl Lab, Upton, NY 11973 USA
[3] CERN, Meyrin, Switzerland
[4] Univ Nebraska Lincoln, Lincoln, NE USA
[5] Lawrence Berkeley Natl Lab, Berkeley, CA USA
[6] Iowa State Univ, Ames, IA USA
关键词
D O I
10.1051/epjconf/202024504015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Towards a Commercial IT Service Delivery
    Ponsard, Christophe
    Dallons, Gautier
    Mouton, Stephane
    Massonet, Philippe
    ERCIM NEWS, 2007, (70): : 22 - 23
  • [2] Towards an intelligent service robot system
    Petersson, L
    Austin, D
    Kragic, D
    Christensen, HI
    INTELLIGENT AUTONOMOUS SYSTEMS 6, 2000, : 704 - 709
  • [3] Intelligent data service for farmers
    Linna, P.
    Narra, N.
    Gronman, J.
    2019 42ND INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2019, : 1072 - 1075
  • [4] Data-driven ontology generation and evolution towards intelligent service in manufacturing systems
    Huang, Chengxi
    Cai, Hongming
    Xu, Lida
    Xu, Boyi
    Gu, Yizhi
    Jiang, Lihong
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 101 : 197 - 207
  • [5] An Intelligent and Cognitive Service Delivery Platform Model
    Zheng, Yong
    Lu, Hanhua
    Sun, Yanfei
    2008 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION TECHNOLOGY APPLICATION, VOL III, PROCEEDINGS, 2008, : 137 - +
  • [6] Towards an Intelligent Framework for Cloud Service Discovery
    Ali, Abdullah Marish
    Shamsuddin, Siti Mariyam
    Eassa, Fathy E.
    Saeed, Faisal
    Alassafi, Madini O.
    Al-Hadhrami, Tawfik
    Elmisery, Ahmed M.
    INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2021, 11 (03) : 33 - 57
  • [7] Towards Intelligent Data Protocols for the Edge
    Donta, Praveen Kumar
    Dustdar, Schahram
    2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND COMMUNICATIONS, EDGE, 2023, : 372 - 380
  • [8] Towards the automation of intelligent data analysis
    Spott, Martin
    Nauck, Detlef
    APPLIED SOFT COMPUTING, 2006, 6 (04) : 348 - 356
  • [9] An Intelligent Data Service Framework for Heterogeneous Data Sources
    Khan, Fakhri Alam
    Rehman, Mujeeb Ur
    Khalid, Afsheen
    Ali, Muhammad
    Imran, Muhammad
    Nawaz, Muhammad
    Rahman, Attaur
    JOURNAL OF GRID COMPUTING, 2019, 17 (03) : 577 - 589
  • [10] An Intelligent Data Service Framework for Heterogeneous Data Sources
    Fakhri Alam Khan
    Mujeeb ur Rehman
    Afsheen Khalid
    Muhammad Ali
    Muhammad Imran
    Muhammad Nawaz
    Attaur Rahman
    Journal of Grid Computing, 2019, 17 : 577 - 589