A multi-tiered data structure and process management system based on ROOT and CouchDB

被引:8
|
作者
Cox, G. A. [1 ]
Armengaud, E. [2 ]
Augier, C. [3 ]
Benoit, A. [4 ]
Berge, L. [5 ]
Bergmann, T. [6 ]
Bluemer, J. [1 ,7 ]
Bres, G. [4 ]
Broniatowski, A. [5 ]
Brudanin, V.
Censier, B. [3 ]
Chapellier, M. [5 ]
Chardin, G. [5 ]
Charlieux, F. [3 ]
Collin, S. [5 ]
Coulter, P. [10 ]
Crauste, O. [5 ]
De Jesus, M. [3 ]
Domange, J. [5 ]
Dumoulin, L. [5 ]
Eitel, K.
Filosofov, D. [8 ]
Fourches, N. [2 ]
Gascon, J. [3 ]
Gerbier, G. [2 ]
Gironne, J. [3 ]
Gros, M. [2 ,3 ]
Henry, S. [10 ]
Herve, S. [2 ]
Jokisch, S. [7 ]
Juillard, A. [3 ]
Kleifges, M. [6 ]
Kluck, H.
Kozlovg, V. [7 ]
Kraus, H. [10 ]
Kudryavtsev, V. A. [9 ]
Loaiza, P. [11 ]
Marnieros, S. [5 ]
Menshikov, A. [6 ]
Navick, X. -F. [2 ]
Nones, C. [2 ]
Olivieri, E.
Pari, P. [12 ]
Pattavina, L. [3 ]
Paul, B. [2 ]
Robinson, M. [9 ]
Rodenas, H. [4 ]
Rozov, S. [8 ]
Sanglard, V.
Schmidt, B. [1 ]
机构
[1] Karlsruhe Inst Technol, Inst Expt Kernphys, D-76128 Karlsruhe, Germany
[2] CEA, Ctr Etud Saclay, IRFU, F-91191 Gif Sur Yvette, France
[3] Univ Lyon 1, IPNL, CNRS, IN2P3, F-69622 Villeurbanne, France
[4] CNRS Neel, F-38042 Grenoble 9, France
[5] Univ Paris 11, CSNSM, CNRS, IN2P3, F-91405 Orsay, France
[6] Karlsruhe Inst Technol, Inst Prozessdatenverarbeitung & Elekt, D-76021 Karlsruhe, Germany
[7] Karlsruhe Inst Technol, Inst Kernphys, D-76021 Karlsruhe, Germany
[8] JINR, Lab Nucl Problems, Dubna 141980, Moscow Region, Russia
[9] Univ Sheffield, Dept Phys & Astron, Sheffield S3 7RH, S Yorkshire, England
[10] Univ Oxford, Dept Phys, Oxford OX1 3RH, England
[11] CEA CNRS, Lab Souterrain Modane, F-73500 Modane, France
[12] CEA, Ctr Etud Saclay, F-91191 Gif Sur Yvette, France
关键词
Data structure; Data management; ROOT; CouchDB; Dark Matter; Multi-tier; DARK-MATTER; PULSE SHAPES;
D O I
10.1016/j.nima.2012.04.049
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
A multi-tiered data structure, analysis toolkit and data processing management system has been constructed using ROOT and CouchDB. This system is well suited for experiments that acquire many computer files of raw data over the course of months or years, that are distributed to different computing centers and further reduced in size by several steps of data processing. Data handling for experiments searching for rare events extracted from digitized pulse traces typically fit this description. An implementation of this system has been constructed for the EDELWEISS-III experiment and is described here in some detail. This solution may also serve as a prototype system for the proposed EURECA experiment. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:63 / 72
页数:10
相关论文
共 50 条
  • [1] Performance of a multi-tiered policy-based management system
    Law, KLE
    Saxena, A
    [J]. NETWORK CONTROL AND ENGINEERING FOR QOS, SECURITY AND MOBILITY, 2003, 107 : 203 - 214
  • [2] Regulation of imprinting: A multi-tiered process
    Rand, E
    Cedar, H
    [J]. JOURNAL OF CELLULAR BIOCHEMISTRY, 2003, 88 (02) : 400 - 407
  • [3] Data Jockey: Automatic Data Management for HPC Multi-Tiered Storage Systems
    Shin, Woong
    Brumgard, Christopher D.
    Xie, Bing
    Vazhkudai, Sudharshan S.
    Ghoshal, Devarshi
    Oral, Sarp
    Ramakrishnan, Lavanya
    [J]. 2019 IEEE 33RD INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2019), 2019, : 511 - 522
  • [4] A Multi-tiered Storage Structure for Cloud Computing
    Chen, Hsin-Ya
    Lee, Pei-Yu
    Chang, Hsung-Pin
    [J]. 2016 INTERNATIONAL COMPUTER SYMPOSIUM (ICS), 2016, : 636 - +
  • [5] The design of a multi-tiered bus timetabling system
    Chun, HW
    Chan, SHC
    [J]. MULTIPLE APPROACHES TO INTELLIGENT SYSTEMS, PROCEEDINGS, 1999, 1611 : 771 - 779
  • [6] Process Evaluation of Literacy Practices within a Multi-Tiered System of Supports Framework
    Morrison, Julie Q.
    Newman, Daniel S.
    Erickson, Amy Gaumer
    [J]. JOURNAL OF APPLIED SCHOOL PSYCHOLOGY, 2021, 37 (02) : 140 - 164
  • [7] Adaptive Data Placement in Multi-Tiered Data Staging Runtime
    Jin, Tong
    Sun, Qian
    Romanus, Melissa
    Parashar, Manish
    [J]. NEW FRONTIERS IN HIGH PERFORMANCE COMPUTING AND BIG DATA, 2017, 30 : 175 - 196
  • [8] A multi-tiered framework for Virtual Instrumentation System (VIS)
    Sen Gupta, G.
    Buhler, A.
    Demidenko, S.
    Messom, C. H.
    Mukhopadhyay, S. C.
    [J]. 2006 IEEE INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE PROCEEDINGS, VOLS 1-5, 2006, : 976 - +
  • [9] A MULTI-TIERED SCREENING SYSTEM FOR THE LEAST RESTRICTIVE SETTING
    ALLEN, RH
    WEINMAN, M
    LORIMOR, R
    CLAGHORN, JL
    [J]. AMERICAN JOURNAL OF PSYCHIATRY, 1980, 137 (08): : 968 - 971
  • [10] A multi-tiered spare parts inventory forecasting system
    Xie, Zhuoqing
    Xie, Hongzhi
    Liu, Shuhui
    Huang, Yijing
    Deng, Xiaolin
    Liu, Biwei
    [J]. INTERNATIONAL JOURNAL OF SPACE-BASED AND SITUATED COMPUTING, 2023, 9 (03) : 165 - 172