Buffer Provisioning for Large-Scale Data-Acquisition Systems

被引:2
|
作者
Santos, Alejandro [1 ,2 ]
Vandelli, Wainer [1 ]
Javier Garcia, Pedro [3 ]
Froening, Holger [2 ]
机构
[1] CERN, Dept Phys, Geneva, Switzerland
[2] Heidelberg Univ, Inst Comp Engn, Heidelberg, Germany
[3] Univ Castilla La Mancha, Comp Syst Dept, Albacete, Spain
关键词
CERN; ATLAS; Data Acquisition System; Simulation; Modeling; OMNeT plus; Buffering; SIMULATION;
D O I
10.1145/3210284.3210288
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The data acquisition system of the ATLAS experiment, a major experiment of the Large Hadron Collider (LHC) at CERN, will go through a major upgrade in the next decade. The upgrade is driven by experimental physics requirements, calling for increased data rates on the order of 6 TB/s. By contrast, the data rate of the existing system is 160 GB/s. Among the changes in the upgraded system will be a very large buffer with a projected size on the order of 70 PB. The buffer role will be decoupling of data production from on-line data processing, storing data for periods of up to 24 hours until it can be analyzed by the event processing system. The larger buffer will allow a new data recording strategy, providing additional margins to handle variable data rates. At the same time it will provide sensible trade-offs between buffering space and on-line processing capabilities. This compromise between two resources will be possible since the data production cycle includes time periods where the experiment will not produce data. In this paper we analyze the consequences of such trade-offs, and introduce a tool that allows a detailed exploration of different strategies for resource provisioning. It is based on a model of the upgraded data acquisition system, implemented in a simulation framework. From this model it is possible to obtain insight into the dynamics of the running system. Given predefined resource constraints, we provide bounds for the provisioning of buffering space and on-line processing requirements.
引用
收藏
页码:100 / 111
页数:12
相关论文
共 50 条
  • [1] LARGE-SCALE DATA-ACQUISITION SYSTEMS
    ZIGLER, GL
    [J]. EXPERIMENTAL MECHANICS, 1978, 18 (05) : N40 - N40
  • [2] Doctoral Symposium: Buffering Strategies for Large-Scale Data-Acquisition Systems
    Santos, Alejandro
    [J]. DEBS'18: PROCEEDINGS OF THE 12TH ACM INTERNATIONAL CONFERENCE ON DISTRIBUTED AND EVENT-BASED SYSTEMS, 2018, : 270 - 273
  • [3] Large-scale Windows 95-based data-acquisition system using LabVIEW
    Mandrake, L
    Gekelman, W
    [J]. COMPUTERS IN PHYSICS, 1997, 11 (05): : 498 - 507
  • [4] DATA-ACQUISITION SYSTEMS
    GORBY, G
    [J]. MEASUREMENTS & CONTROL, 1995, (169): : 98 - 101
  • [5] Optimizing the data-collection time of a large-scale data-acquisition system through a simulation framework
    Colombo, Tommaso
    Froening, Holger
    Javier Garcia, Pedro
    Vandelli, Wainer
    [J]. JOURNAL OF SUPERCOMPUTING, 2016, 72 (12): : 4546 - 4572
  • [6] Optimizing the data-collection time of a large-scale data-acquisition system through a simulation framework
    Tommaso Colombo
    Holger Fröning
    Pedro Javier Garcìa
    Wainer Vandelli
    [J]. The Journal of Supercomputing, 2016, 72 : 4546 - 4572
  • [7] New developments in large-scale dynamic data acquisition systems
    Smith, S
    Katz, S
    Hollowell, B
    Olson, E
    Brower, A
    Franz, B
    Snyder, S
    [J]. SOUND AND VIBRATION, 1998, 32 (04): : 18 - 22
  • [8] Portable data-acquisition systems
    不详
    [J]. AIRCRAFT ENGINEERING AND AEROSPACE TECHNOLOGY, 2004, 76 (02): : 263 - 264
  • [9] MICROCOMPUTER DATA-ACQUISITION SYSTEMS
    WYNNE, DR
    [J]. CHEMICAL ENGINEERING, 1984, 91 (24) : 95 - 96
  • [10] A C plus plus Shared-Memory Ring-Buffer Framework for Large-Scale Data Acquisition Systems
    Ingles, Rolando
    Orlikowski, Mariusz
    Napieralski, Andrzej
    [J]. PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE MIXED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS - MIXDES 2017, 2017, : 161 - 166