PROCESSING RADIO ASTRONOMICAL DATA USING THE PROCESS SOFTWARE ECOSYSTEM

被引：1

作者：

Madougou, Souley ^{[1
]}

Spreeuw, Hanno ^{[1
]}

Maassen, Jason ^{[1
]}

机构：

[1] Netherlands eSci Ctr, Sci Pk 140,Matrix 1, NL-1098 XG Amsterdam, Netherlands

来源：

COMPUTING AND INFORMATICS | 2020年 / 39卷 / 04期

关键词：

Radio astronomy; imaging; extreme large scale data processing; PC clusters; distributed computing; grid; cloud computing;

D O I：

10.31577/cai_2020_4_838

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper we discuss our efforts in "unlocking" the Long Term Archive (LTA) of the LOFAR radio telescope using the software ecosystem developed in the PROCESS project. The LTA is a large (> 50 PB) archive that expands with about 7 PB per year by the ingestion of new observations. It consists of coarsely calibrated "visibilities", i.e. correlations between signals from LOFAR stations. Converting these observations into sky maps (images), which are needed for astronomy research, can be challenging due to the data sizes of the observations and the complexity and compute requirements of the software involved. Using the PROCESS software environment and testbed, we enable a simple point-and-click-reduction of LOFAR observations into sky maps for users of this archive. This work was performed as part of the PROCESS project which aims to provide generalizable open source solutions for user friendly exascale data processing.

引用

页码：838 / 859

页数：22

共 50 条

[1] CoLiTec Software for the Astronomical Data Sets Processing
Khlamov, Sergii
Savanevych, Vadym
Briukhovetskyi, Olexander
Pohorelov, Artem
Vlasenko, Vladimir
Dikov, Eugen
[J]. 2018 IEEE SECOND INTERNATIONAL CONFERENCE ON DATA STREAM MINING & PROCESSING (DSMP), 2018, : 227 - 230
[2] Development of radio astronomical data reduction software NEWSTAR
Ikeda, M
Nishiyama, K
Ohishi, M
Tatematsu, K
[J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS X, 2001, 238 : 522 - 524
[3] Processing of CHAMP radio occultation data using GRAS SAF software
Larsen, GB
Lauritsen, KB
Rubek, F
Sorensen, MB
[J]. EARTH OBSERVATION WITH CHAMP: RESULTS FROM THREE YEARS ORBIT, 2005, : 543 - 548
[4] DECH: A Software Package for Astronomical Spectral Data Processing and Analysis
Galazutdinov, G. A.
[J]. ASTROPHYSICAL BULLETIN, 2022, 77 (04) : 519 - 529
[5] DECH: A Software Package for Astronomical Spectral Data Processing and Analysis
G. A. Galazutdinov
[J]. Astrophysical Bulletin, 2022, 77 : 519 - 529
[6] Software radio receiver for seismic data processing
Ernou, Y
Fortier, P
Grouffal, C
[J]. CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING 2001, VOLS I AND II, CONFERENCE PROCEEDINGS, 2001, : 165 - 170
[7] Signal processing for radio astronomical arrays
van der Veen, AJ
Leshem, A
Boonstra, AJ
[J]. 2004 IEEE SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP, 2004, : 1 - 10
[8] SIGNAL PROCESSING CHALLENGES FOR RADIO ASTRONOMICAL ARRAYS
Wijnholds, S. J.
van der Veen, A. -J.
De Stefani, F.
La Rosa, E.
Farina, A.
[J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
[9] Distributed processing of future radio astronomical observations
van Diepen, Ger
[J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XVII, 2008, 394 : 87 - 90
[10] Software Process as a Service: Towards A Software Process Ecosystem
Greulich, Oliver
Knieke, Christoph
Rafie, Bassel
Rausch, Andreas
Kuhrmann, Marco
[J]. PROCEEDINGS OF THE 2024 INTERNATIONAL CONFERENCE ON SOFTWARE AND SYSTEMS PROCESSES, ICSSP 2024, 2024, : 77 - 86

← 1 2 3 4 5 →