Towards an Intelligent Data Delivery Service

被引:1
|
作者
Guan, Wen [1 ]
Maeno, Tadashi [2 ]
Dimitrov, Gancho [3 ]
Bockelman, Brian Paul [4 ]
Wenaus, Torre [2 ]
Tsulaia, Vakhtang [5 ]
Magini, Nicolo [6 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Brookhaven Natl Lab, Upton, NY 11973 USA
[3] CERN, Meyrin, Switzerland
[4] Univ Nebraska Lincoln, Lincoln, NE USA
[5] Lawrence Berkeley Natl Lab, Berkeley, CA USA
[6] Iowa State Univ, Ames, IA USA
关键词
D O I
10.1051/epjconf/202024504015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] Towards optimized data fetching for service discovery
    Zaremba, Maciej
    Vitvar, Tomas
    Moran, Matthew
    ECOWS 07: PROCEEDING OF THE 5TH IEEE EUROPEAN CONFERENCE ON WEB SERVICES, 2007, : 191 - 200
  • [42] Towards protected VNFs for multi-operator service delivery
    Marku, Enio
    Biczok, Gergely
    Boyd, Colin
    PROCEEDINGS OF THE 2019 IEEE CONFERENCE ON NETWORK SOFTWARIZATION (NETSOFT 2019), 2019, : 19 - 23
  • [43] Towards rural inclusion: improving the governance of service delivery in Nigeria
    Popoola, Ayobami
    Magidimisha-Chipungu, Hangwelani
    Chipungu, Lovemore
    COGENT SOCIAL SCIENCES, 2022, 8 (01):
  • [44] Trends in Rural Water Supply: Towards a Service Delivery Approach
    Moriarty, Patrick
    Smits, Stef
    Butterworth, John
    Franceys, Richard
    WATER ALTERNATIVES-AN INTERDISCIPLINARY JOURNAL ON WATER POLITICS AND DEVELOPMENT, 2013, 6 (03): : 329 - 349
  • [45] Towards Risk-Aware Planning of Service Delivery Operations
    Vasa, Mitesh
    Jadatharan, Ashok
    Srivastava, Biplav
    2015 IEEE 12TH INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2015), 2015, : 82 - 89
  • [46] Towards a Service Delivery Based on Customer eXperience Ontology: Shift from Service to eXperience
    Laghari, Khalil Ur Rehman
    Ben Yahya, Imen Grida
    Crespi, Noel
    MODELLING AUTONOMIC COMMUNICATION ENVIRONMENTS, 2010, 6473 : 51 - 61
  • [47] Toward Democratizing Access to Facilities Data: A Framework for Intelligent Data Discovery and Delivery
    Qin, Yubo
    Rodero, Ivan
    Parashar, Manish
    COMPUTING IN SCIENCE & ENGINEERING, 2022, 24 (03) : 52 - 60
  • [48] Data-Less Big Data Analytics (Towards Intelligent Data Analytics Systems)
    Triantafillou, Peter
    2018 IEEE 34TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2018, : 1666 - 1667
  • [49] Service benchmarking: Towards the productivity improvement in service sector by data utilization
    Okuma, Takashi
    Matsumoto, Mitsutaka
    Kinoshita, Takashi
    Journal of the Institute of Electronics, Information and Communication Engineers, 2014, 97 (12): : 1115 - 1120
  • [50] Intelligent matchmaking for polar ice sheet data collection and delivery
    Tsatsoulis, C
    Sivashanmugam, S
    Perry, S
    IGARSS 2004: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM PROCEEDINGS, VOLS 1-7: SCIENCE FOR SOCIETY: EXPLORING AND MANAGING A CHANGING PLANET, 2004, : 1711 - 1714