File-based data flow in the CMS Filter Farm

被引：1

作者：

Andre, J-M ^{[5
]}

Andronidis, A. ^{[2
]}

Bawej, T. ^{[2
]}

Behrens, U. ^{[1
]}

Branson, J. ^{[4
]}

Chaze, O. ^{[2
]}

Cittolin, S. ^{[4
]}

Darlea, G-L ^{[6
]}

Deldicque, C. ^{[2
]}

Dobson, M. ^{[2
]}

Dupont, A. ^{[2
]}

Erhan, S. ^{[3
]}

Gigi, D. ^{[2
]}

Glege, F. ^{[2
]}

Gomez-Ceballos, G. ^{[6
]}

Hegeman, J. ^{[2
]}

Holzner, A. ^{[4
]}

Jimenez-Estupinan, R. ^{[2
]}

Masetti, L. ^{[2
]}

Meijers, F. ^{[2
]}

Meschi, E. ^{[2
]}

Mommsen, R. K. ^{[5
]}

Morovic, S. ^{[2
]}

Nunez-Barranco-Fernandez, C. ^{[2
]}

O'Dell, V. ^{[2
,5
]}

Orsini, L. ^{[2
]}

Paus, C. ^{[6
]}

Petrucci, A. ^{[2
]}

Pieri, M. ^{[4
]}

Racz, A. ^{[2
]}

Roberts, P. ^{[2
]}

Sakulin, H. ^{[2
]}

Schwick, C. ^{[2
]}

Stieger, B. ^{[2
]}

Sumorok, K. ^{[6
]}

Veverka, J. ^{[6
]}

Zaza, S. ^{[2
]}

Zejdl, P. ^{[2
]}

机构：

[1] DESY, Hamburg, Germany

[2] CERN, CH-1211 Geneva 23, Switzerland

[3] Univ Calif Los Angeles, Los Angeles, CA USA

[4] Univ Calif San Diego, San Diego, CA 92103 USA

[5] FNAL, Batavia, IL USA

[6] MIT, Cambridge, MA 02139 USA

来源：

21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9 | 2015年 / 664卷

关键词：

D O I：

10.1088/1742-6596/664/8/082033

中图分类号：

O57 [原子核物理学、高能物理学];

学科分类号：

070202 ;

摘要：

During the LHC Long Shutdown 1, the CMS Data Acquisition system underwent a partial redesign to replace obsolete network equipment, use more homogeneous switching technologies, and prepare the ground for future upgrades of the detector front-ends. The software and hardware infrastructure to provide input, execute the High Level Trigger (HLT) algorithms and deal with output data transport and storage has also been redesigned to be completely file based. This approach provides additional decoupling between the HLT algorithms and the input and output data flow. All the metadata needed for bookkeeping of the data flow and the HLT process lifetimes are also generated in the form of small "documents" using the JSON encoding, by either services in the flow of the HLT execution (for rates etc.) or watchdog processes. These "files" can remain memory-resident or be written to disk if they are to be used in another part of the system (e.g. for aggregation of output data). We discuss how this redesign improves the robustness and flexibility of the CMS DAQ and the performance of the system currently being commissioned for the LHC Run 2.

引用

页数：8

共 50 条

[1] File-based data processing on MESSENGER
Krupiarz, CJ
Artis, DA
Calloway, AB
Frangos, CM
Heggestad, BK
Holland, DB
Stratton, WC
[J]. PROCEEDINGS OF THE FIFTH IAA INTERNATIONAL CONFERENCE ON LOW-COST PLANETARY MISSIONS, 2003, 542 : 435 - 442
[2] Prototype of a File-Based High-Level Trigger in CMS
Bauer, G.
Bawej, T.
Behrens, U.
Branson, J.
Chaze, O.
Cittolin, S.
Coarasa, J. A.
Darlea, G-L
Deldicque, C.
Dobson, M.
Dupont, A.
Erhan, S.
Gigi, D.
Glege, F.
Gomez-Ceballos, G.
Gomez-Reino, R.
Hartl, C.
Hegeman, J.
Holzner, A.
Masetti, L.
Meijers, F.
Meschi, E.
Mommsen, R. K.
Morovic, S.
Nunez-Barranco-Fernandez, C.
O'Dell, V.
Orsini, L.
Ozga, W.
Paus, C.
Petrucci, A.
Pieri, M.
Racz, A.
Raginel, O.
Sakulin, H.
Sani, M.
Schwick, C.
Spataru, A. C.
Stieger, B.
Sumorok, K.
Veverka, J.
Wakefiled, C. C.
Zejdl, P.
[J]. 20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
[3] File-based data processing on MESSENGER
Krupiarz, Christopher J.
Artis, David A.
Calloway, Andrew B.
Frangos, Constantine M.
Heggestad, Brian K.
Holland, Douglas B.
Stratton, William C.
[J]. ACTA ASTRONAUTICA, 2006, 59 (8-11) : 1071 - 1078
[4] Semantic integration of file-based data for grid services
Woolf, A
Cramer, R
Gutierrez, M
van Dam, KK
Kondapalli, S
Latham, S
Lawrence, B
Lowry, R
O'Neill, K
[J]. 2005 IEEE International Symposium on Cluster Computing and the Grid, Vols 1 and 2, 2005, : 182 - 188
[5] Research and Design of a File-Based Continuous Data Protection
Yang, Zongbo
Guo, Yudong
[J]. ITESS: 2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES, PT 1, 2008, : 93 - 99
[6] File-Based Sports Production
Bergeron, Michael
[J]. SMPTE MOTION IMAGING JOURNAL, 2010, 119 (04): : 56 - 63
[7] File-Based Workflows Update
Footen, John
Kovalick, Al
[J]. SMPTE MOTION IMAGING JOURNAL, 2011, 120 (06): : 69 - 71
[8] File-based replica management
Kunszt, P
Laure, E
Stockinger, H
Stockinger, K
[J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2005, 21 (01): : 115 - 123
[9] File-based localization of numerical perturbations in data analysis pipelines
Salari, Ali
Kiar, Gregory
Lewis, Lindsay
Evans, Alan C.
Glatard, Tristan
[J]. GIGASCIENCE, 2020, 9 (12):
[10] A File-Based Linked Data Fragments Approach to Prefix Search
Dedecker, Ruben
Delva, Harm
Colpaert, Pieter
Verborgh, Ruben
[J]. WEB ENGINEERING, ICWE 2021, 2021, 12706 : 53 - 67

← 1 2 3 4 5 →