An overview of a large-scale data migration

被引:3
|
作者
Lübeck, M [1 ]
Geppert, D [1 ]
Nienartowicz, K [1 ]
Nowak, M [1 ]
Valassi, A [1 ]
机构
[1] CERN, European Org Nucl Res, Div IT, Database Grp, CH-1211 Geneva 23, Switzerland
关键词
D O I
10.1109/MASS.2003.1194835
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present an overview of the migration of the data collected by the COMPASS experiment at CERN. In less than three months, almost 300 TB will be migrated at a sustained data rate approaching 100 MB/s, using a distributed system with multiple nodes and data servers. This project, which is being carried out by the Database Group of CERN's IT Division and is expected to be completed by early 2003, involves both a physical media migration, from StorageTek 9940A to StorageTek 9940B tapes, and a data format conversion, from an Object Database Management System to a hybrid persistency mechanism based on flat files referenced in a Relational Database Management System.
引用
收藏
页码:49 / 55
页数:7
相关论文
共 50 条
  • [1] Metadata Exploitation in Large-scale Data Migration Projects
    Narayanan, Ram
    Oberhofer, Martin
    Pandit, Sushain
    [J]. AMCIS 2012 PROCEEDINGS, 2012,
  • [2] Use of HPC-Techniques for Large-Scale Data Migration
    Duennweber, Jan
    Mihaylov, Valentin
    Glettler, Rene
    Maiborn, Volker
    Wolff, Holger
    [J]. EURO-PAR 2011: PARALLEL PROCESSING WORKSHOPS, PT I, 2012, 7155 : 408 - 415
  • [3] An implementation of Kirchhoff integral prestack migration for large-scale data
    Wang Hua-Zhong
    Cai Jie-Xiong
    Kong Xiang-Ning
    Zhang Bin
    Zhu Hai-Bo
    Fang Wu-Bao
    [J]. CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2010, 53 (07): : 1699 - 1709
  • [4] Proactive Data Migration for Improved Storage Availability in Large-Scale Data Centers
    Wu, Suzhen
    Jiang, Hong
    Mao, Bo
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2015, 64 (09) : 2637 - 2651
  • [5] LARGE-SCALE MOTIONS ON THE SUN - AN OVERVIEW
    BOGART, RS
    [J]. SOLAR PHYSICS, 1987, 110 (01) : 23 - 34
  • [6] Accelerate Large-Scale Seismic Data Kirchhoff Time Migration in Spark
    Tian, Yang
    Liu, Chao
    Yan, Haihua
    [J]. 2018 4TH INTERNATIONAL CONFERENCE ON INFORMATION MANAGEMENT (ICIM2018), 2018, : 41 - 45
  • [7] PERSPECTIVES OF A LARGE-SCALE ENVIRONMENTAL SURVEY FOR CHLORINATED DIOXINS - OVERVIEW AND SOIL DATA
    NESTRICK, TJ
    LAMPARSKI, LL
    FRAWLEY, NN
    HUMMEL, RA
    KOCHER, CW
    MAHLE, NH
    MCCOY, JW
    MILLER, DL
    PETERS, TL
    PILLEPICH, JL
    SMITH, WE
    TOBEY, SW
    [J]. CHEMOSPHERE, 1986, 15 (9-12) : 1453 - 1460
  • [8] A Large-Scale Benchmark Data Set for Evaluating Pansharpening Performance: Overview and Implementation
    Meng, Xiangchao
    Xiong, Yiming
    Shao, Feng
    Shen, Huanfeng
    Sun, Weiwei
    Yang, Gang
    Yuan, Qiangqiang
    Fu, Randi
    Zhang, Hongyan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2021, 9 (01) : 18 - 52
  • [9] Portrait of decentralized application users: an overview based on large-scale Ethereum data
    Tian Min
    Wei Cai
    [J]. CCF Transactions on Pervasive Computing and Interaction, 2022, 4 : 124 - 141
  • [10] Portrait of decentralized application users: an overview based on large-scale Ethereum data
    Min, Tian
    Cai, Wei
    [J]. CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2022, 4 (02) : 124 - 141