Towards an Intelligent Data Delivery Service

被引:1
|
作者
Guan, Wen [1 ]
Maeno, Tadashi [2 ]
Dimitrov, Gancho [3 ]
Bockelman, Brian Paul [4 ]
Wenaus, Torre [2 ]
Tsulaia, Vakhtang [5 ]
Magini, Nicolo [6 ]
机构
[1] Univ Wisconsin, Madison, WI 53706 USA
[2] Brookhaven Natl Lab, Upton, NY 11973 USA
[3] CERN, Meyrin, Switzerland
[4] Univ Nebraska Lincoln, Lincoln, NE USA
[5] Lawrence Berkeley Natl Lab, Berkeley, CA USA
[6] Iowa State Univ, Ames, IA USA
关键词
D O I
10.1051/epjconf/202024504015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Consumers acceptance of artificially intelligent (AI) device use in service delivery
    Gursoy, Dogan
    Chi, Oscar Hengxuan
    Lu, Lu
    Nunkoo, Robin
    INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2019, 49 (157-169) : 157 - 169
  • [32] Towards an Integrated Solution for Intelligent Visual Data Discovery
    Lee, Doris Jung-Lin
    CHI'20: EXTENDED ABSTRACTS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2020,
  • [33] Towards an intelligent framework for multimodal affective data analysis
    Poria, Soujanya
    Cambria, Erik
    Hussain, Amir
    Huang, Guang-Bin
    NEURAL NETWORKS, 2015, 63 : 104 - 116
  • [34] Towards an intelligent evaluation method of medical data visualizations
    Amri, Saber
    Ltifi, Hela
    Ben Ayed, Mounir
    2015 15TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS (ISDA), 2015, : 673 - 678
  • [35] Intelligent Learning for Knowledge Graph towards Geological Data
    Zhu, Yueqin
    Zhou, Wenwen
    Xu, Yang
    Liu, Ji
    Tan, Yongjie
    SCIENTIFIC PROGRAMMING, 2017, 2017
  • [36] HybridFlow: Towards Intelligent Video Delivery and Processing Over Hybrid Infrastructures
    Dumitru, Cosmin
    Zhao, Zhiming
    Grosso, Paola
    de Laat, Cees
    PROCEEDINGS OF THE 2013 INTERNATIONAL CONFERENCE ON COLLABORATION TECHNOLOGIES AND SYSTEMS (CTS), 2013, : 473 - 478
  • [37] The design and implementation of service independent configuration of user service data in intelligent network
    Lei, YX
    Shi, Y
    Meng, LM
    Chen, JL
    1996 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY, VOLUMES 1 AND 2 - PROCEEDINGS, 1996, : 404 - 407
  • [38] Intelligent products -: a step towards a more effective project delivery chain
    Kärkkäinen, M
    Holmström, J
    Främling, K
    Artto, K
    COMPUTERS IN INDUSTRY, 2003, 50 (02) : 141 - 151
  • [39] Towards intelligent web services for-automating medical service composition
    Lee, Y
    Patel, C
    Chun, SA
    Geller, J
    IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, PROCEEDINGS, 2004, : 384 - 391
  • [40] Towards Biological Sequence Data Service with Insights
    Chen, Huaming
    Shen, Jun
    Wang, Lei
    Chi, Chi-Hung
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 2847 - 2854