PROCESSING RADIO ASTRONOMICAL DATA USING THE PROCESS SOFTWARE ECOSYSTEM

被引：1

作者：

Madougou, Souley ^{[1
]}

Spreeuw, Hanno ^{[1
]}

Maassen, Jason ^{[1
]}

机构：

[1] Netherlands eSci Ctr, Sci Pk 140,Matrix 1, NL-1098 XG Amsterdam, Netherlands

来源：

COMPUTING AND INFORMATICS | 2020年 / 39卷 / 04期

关键词：

Radio astronomy; imaging; extreme large scale data processing; PC clusters; distributed computing; grid; cloud computing;

D O I：

10.31577/cai_2020_4_838

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper we discuss our efforts in "unlocking" the Long Term Archive (LTA) of the LOFAR radio telescope using the software ecosystem developed in the PROCESS project. The LTA is a large (> 50 PB) archive that expands with about 7 PB per year by the ingestion of new observations. It consists of coarsely calibrated "visibilities", i.e. correlations between signals from LOFAR stations. Converting these observations into sky maps (images), which are needed for astronomy research, can be challenging due to the data sizes of the observations and the complexity and compute requirements of the software involved. Using the PROCESS software environment and testbed, we enable a simple point-and-click-reduction of LOFAR observations into sky maps for users of this archive. This work was performed as part of the PROCESS project which aims to provide generalizable open source solutions for user friendly exascale data processing.

引用

页码：838 / 859

页数：22

共 50 条

[31] BoF summary: Astronomical data processing and VO
Tody, Douglas
Grosbol, Preben
[J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XVI, 2007, 376 : 681 - +
[32] Software tools using CSRBFs for processing scattered data
Kojekine, N
Hagiwara, I
Savchenko, V
[J]. COMPUTERS & GRAPHICS-UK, 2003, 27 (02): : 311 - 319
[33] An Applications Framework for Astronomical Data Processing and Analysis
Tody, D.
Grosbol, P.
Cotton, W.
Currie, M. J.
Fitzpatrick, M.
Paioro, L.
Surace, C.
[J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XVIII, 2009, 411 : 514 - +
[34] A SOFTWARE SYSTEM FOR REDUCTION AND VISUALIZATION OF ASTRONOMICAL PHOTOELECTRIC DATA
KIROV, NK
ANTOV, AP
GENKOV, VV
[J]. DOKLADI NA BOLGARSKATA AKADEMIYA NA NAUKITE, 1991, 44 (11): : 5 - 8
[35] NEW DEVELOPMENTS IN JASTROCAM - SOFTWARE FOR ASTRONOMICAL DATA GATHERING
Zola, S.
Budyn, M.
[J]. III WORKSHOP ON ROBOTIC AUTONOMOUS OBSERVATORIES, 2014, 45 : 45 - 46
[36] Providing Legacy Access to Astronomical Data Analysis Software
Huygen, Rik
Vandenbussche, Bart
De Meester, Wim
De Jong, Jeroen
Wieprecht, Ekkehard
Wetzstein, Michael
[J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXI, 2012, 461 : 639 - +
[37] Cognitive Radio and Software Defined Radio: Signal Processing Perspectives
Arslan, Hueseyin
Goercin, Ali
[J]. 2008 IEEE 16TH SIGNAL PROCESSING, COMMUNICATION AND APPLICATIONS CONFERENCE, VOLS 1 AND 2, 2008, : 873 - 877
[38] RADIO ASTRONOMICAL SYNTHESIS ARRAYS - REAL-TIME PROCESSING NEEDS
BURNS, WR
EWING, MS
[J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1983, 431 : 41 - 47
[39] Gaspra - software for astronomical image processing in high performance computing clusters
Andrijauskas, Fabio
Sampaio Gradvohl, Andre Leon
[J]. REVISTA BRASILEIRA DE COMPUTACAO APLICADA, 2014, 6 (02): : 87 - 97
[40] A component-based framework for radio-astronomical imaging software systems
Kemball, A. J.
Crutcher, R. M.
Hasan, R.
[J]. SOFTWARE-PRACTICE & EXPERIENCE, 2008, 38 (05): : 493 - 507

← 1 2 3 4 5 →