A new archival infrastructure for highly-structured astronomical data

被引:1
|
作者
Dovgan, Erik [1 ,2 ]
Knapic, Cristina [1 ]
Sponza, Massimo [1 ]
Smareglia, Riccardo [1 ]
机构
[1] Natl Inst Astrophys, Astron Observ Trieste, Via GB Tiepolo 11, I-34143 Trieste, Italy
[2] Jozef Stefan Inst, Dept Intelligent Syst, Jamova Cesta 39, SI-1000 Ljubljana, Slovenia
关键词
Radioastronomy; Archives; Big data;
D O I
10.1007/s10686-018-9571-8
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
With the advent of the 2020 Radio Astronomy Telescopes era, the amount and format of the radioastronomical data is becoming a massive and performance-critical challenge. Such an evolution of data models and data formats require new data archiving techniques that allow massive and fast storage of data that are at the same time also efficiently processed. A useful expertise for efficient archiviation has been obtained through data archiving of Medicina and Noto Radio Telescopes. The presented archival infrastructure named the Radio Archive stores and handles various formats, such as FITS, MBFITS, and VLBI's XML, which includes description and ancillary files. The modeling and architecture of the archive fulfill all the requirements of both data persistence and easy data discovery and exploitation. The presented archive already complies with the Virtual Observatory directives, therefore future service implementations will also be VO compliant. This article presents the Radio Archive services and tools, from the data acquisition to the end-user data utilization.
引用
收藏
页码:41 / 55
页数:15
相关论文
共 50 条
  • [1] A new archival infrastructure for highly-structured astronomical data
    Erik Dovgan
    Cristina Knapic
    Massimo Sponza
    Riccardo Smareglia
    [J]. Experimental Astronomy, 2018, 45 : 41 - 55
  • [2] Inducing classification rules from highly-structured data with composition
    MacKinney-Romero, R
    Giraud-Carrier, C
    [J]. MICAI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2004, 2972 : 262 - 271
  • [3] A new DOAS parameterization for retrieval of trace gases with highly-structured absorption spectra
    Maurellis, AN
    Lang, R
    van der Zande, WJ
    [J]. GEOPHYSICAL RESEARCH LETTERS, 2000, 27 (24) : 4069 - 4072
  • [4] HIGHLY-STRUCTURED INTERPRETER FOR A SNOBOL4 SUBSET
    PAGAN, FG
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 1979, 9 (04): : 281 - 312
  • [5] Temporal differentiators based on highly-structured fibre Bragg gratings
    Gatti, D.
    Fernandez, T. T.
    Longhi, S.
    Laporta, P.
    [J]. ELECTRONICS LETTERS, 2010, 46 (13) : 943 - U104
  • [6] A DataSpace infrastructure for astronomical data
    Grossman, R
    Creel, E
    Mazzucco, M
    Williams, R
    [J]. DATA MINING FOR SCIENTIFIC AND ENGINEERING APPLICATIONS, 2001, 2 : 115 - 123
  • [7] Modelling Highly-Structured Turn Based Games Using Interaction Beliefs
    Szirbik, N. B.
    Roest, G. B.
    Stuit, M.
    [J]. GAMEON-NA 2008: 4TH INTERNATIONAL NORTH-AMERICAN CONFERENCE ON INTELLIGENT GAMES AND SIMULATION, 2008, : 63 - 67
  • [8] SAADA: An automatic archival system for astronomical data
    Nguyen, NH
    Michel, L
    Motch, C
    [J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XIII, 2004, 314 : 121 - 124
  • [9] Generating Highly-structured Input Data by Combining Search-based Testing and Grammar-based Fuzzing
    Olsthoorn, Mitchell
    van Deursen, Arie
    Panichella, Annibale
    [J]. 2020 35TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2020), 2020, : 1224 - 1228
  • [10] Argonaute-based programmable RNase as a tool for cleavage of highly-structured RNA
    Dayeh, Daniel M.
    Cantara, William A.
    Kitzrow, Jonathan P.
    Musier-Forsyth, Karin
    Nakanishi, Kotaro
    [J]. NUCLEIC ACIDS RESEARCH, 2018, 46 (16)