File-based data flow in the CMS Filter Farm

被引：1

作者：

Andre, J-M ^{[5
]}

Andronidis, A. ^{[2
]}

Bawej, T. ^{[2
]}

Behrens, U. ^{[1
]}

Branson, J. ^{[4
]}

Chaze, O. ^{[2
]}

Cittolin, S. ^{[4
]}

Darlea, G-L ^{[6
]}

Deldicque, C. ^{[2
]}

Dobson, M. ^{[2
]}

Dupont, A. ^{[2
]}

Erhan, S. ^{[3
]}

Gigi, D. ^{[2
]}

Glege, F. ^{[2
]}

Gomez-Ceballos, G. ^{[6
]}

Hegeman, J. ^{[2
]}

Holzner, A. ^{[4
]}

Jimenez-Estupinan, R. ^{[2
]}

Masetti, L. ^{[2
]}

Meijers, F. ^{[2
]}

Meschi, E. ^{[2
]}

Mommsen, R. K. ^{[5
]}

Morovic, S. ^{[2
]}

Nunez-Barranco-Fernandez, C. ^{[2
]}

O'Dell, V. ^{[2
,5
]}

Orsini, L. ^{[2
]}

Paus, C. ^{[6
]}

Petrucci, A. ^{[2
]}

Pieri, M. ^{[4
]}

Racz, A. ^{[2
]}

Roberts, P. ^{[2
]}

Sakulin, H. ^{[2
]}

Schwick, C. ^{[2
]}

Stieger, B. ^{[2
]}

Sumorok, K. ^{[6
]}

Veverka, J. ^{[6
]}

Zaza, S. ^{[2
]}

Zejdl, P. ^{[2
]}

机构：

[1] DESY, Hamburg, Germany

[2] CERN, CH-1211 Geneva 23, Switzerland

[3] Univ Calif Los Angeles, Los Angeles, CA USA

[4] Univ Calif San Diego, San Diego, CA 92103 USA

[5] FNAL, Batavia, IL USA

[6] MIT, Cambridge, MA 02139 USA

来源：

21ST INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2015), PARTS 1-9 | 2015年 / 664卷

关键词：

D O I：

10.1088/1742-6596/664/8/082033

中图分类号：

O57 [原子核物理学、高能物理学];

学科分类号：

070202 ;

摘要：

During the LHC Long Shutdown 1, the CMS Data Acquisition system underwent a partial redesign to replace obsolete network equipment, use more homogeneous switching technologies, and prepare the ground for future upgrades of the detector front-ends. The software and hardware infrastructure to provide input, execute the High Level Trigger (HLT) algorithms and deal with output data transport and storage has also been redesigned to be completely file based. This approach provides additional decoupling between the HLT algorithms and the input and output data flow. All the metadata needed for bookkeeping of the data flow and the HLT process lifetimes are also generated in the form of small "documents" using the JSON encoding, by either services in the flow of the HLT execution (for rates etc.) or watchdog processes. These "files" can remain memory-resident or be written to disk if they are to be used in another part of the system (e.g. for aggregation of output data). We discuss how this redesign improves the robustness and flexibility of the CMS DAQ and the performance of the system currently being commissioned for the LHC Run 2.

引用

页数：8

共 50 条

[31] File-based closed captioning system without captioning delay
Kim, Yunhyoung
Han, Sunghee
Choi, Sungwoo
Jung, Byunghee
[J]. ABU Technical Review, 2015, (264): : 7 - 10
[32] Case Study: File-Based Workflow from Acquisition to Air
Foti, Michael
[J]. SMPTE MOTION IMAGING JOURNAL, 2010, 119 (04): : 64 - 67
[33] Utilizing monte carlo for log file-based delivery QA
Stanhope, C.
Drake, D.
Alber, M.
Sohn, M.
Liang, J.
Habib, C.
Yan, D.
[J]. RADIOTHERAPY AND ONCOLOGY, 2017, 123 : S509 - S510
[34] panMetaDocs, eSciDoc, and DOIDB-An Infrastructure for the Curation and Publication of File-Based Datasets for GFZ Data Services
Ulbricht, Damian
Elger, Kirsten
Bertelmann, Roland
Klump, Jens
[J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2016, 5 (03):
[35] File-Based Workflows: Key Challenges in Real-World Facilities
De Geyter, Matthias
Overmeire, Luk
[J]. SMPTE MOTION IMAGING JOURNAL, 2011, 120 (02): : 37 - 42
[36] Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2
Poeschel, Franz
Juncheng, E.
Godoy, William F.
Podhorszki, Norbert
Klasky, Scott
Eisenhauer, Greg
Davis, Philip E.
Wan, Lipeng
Gainaru, Ana
Gu, Junmin
Koller, Fabian
Widera, Rene
Bussmann, Michael
Huebl, Axel
[J]. DRIVING SCIENTIFIC AND ENGINEERING DISCOVERIES THROUGH THE INTEGRATION OF EXPERIMENT, BIG DATA, AND MODELING AND SIMULATION, 2022, 1512 : 99 - 118
[37] File-based Memory Management for Non-Volatile Main Memory
Oikawa, Shuichi
Miki, Satoshi
[J]. 2013 IEEE 37TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), 2013, : 559 - 568
[38] Report from the Standards Vice President: Standards for File-Based Workflows
[J]. 1600, Society of Motion Picture and Television Engineers (126):
[39] Reliability of file-based retrospective ratings of psychopathy with the PCL-R
Grann, M
Langstrom, N
Tengstrom, A
Stalenheim, EG
[J]. JOURNAL OF PERSONALITY ASSESSMENT, 1998, 70 (03) : 416 - 426
[40] Defense and Attack Techniques Against File-Based TOCTOU Vulnerabilities: A Systematic Review
Raducu, Razvan
Rodriguez, Ricardo J.
Alvarez, Pedro
[J]. IEEE ACCESS, 2022, 10 : 21742 - 21758

← 1 2 3 4 5 →