Python']Python and pipelines: Python']Python interfaces for ESO's CPL & HDRL data reduction libraries

被引:0
|
作者
Horton, Anthony [1 ]
Heng, Anthony [1 ]
Farrell, Aidan [1 ]
Deshpande, Mrunmayi [1 ]
Miszalski, Brent [1 ]
Fernando, Nuwanthika [1 ]
Lorente, Nuria [1 ]
Palsa, Ralf [2 ]
Lundin, Lars [2 ]
Gabasch, Armin [2 ]
机构
[1] Macquarie Univ, Australian Astron Opt, Sydney, NSW, Australia
[2] European Southern Observ, Karl Schwarzschild Str 2, Garching, Germany
关键词
PyCPL; PyHDRL; CPL; HDRL; data reduction pipeline; !text type='Python']Python[!/text] bindings; pybind11; scientific [!text type='Python']Python[!/text;
D O I
10.1117/12.3019678
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
The ESO Common Pipeline Library (CPL) and High Level Data Reduction Library (HDRL) together form a comprehensive, efficient and robust software toolkit for data reduction pipelines. They were developed in C for reasons of efficiency and speed, however, with the community's preference towards Python for algorithm prototyping and data reduction, there is a need for access from Python. PyCPL and PyHDRL provide this, making it possible to run existing CPL data reduction recipes from Python as well as developing new recipes in Python. These new recipes are built using the PyCPL and PyHDRL libraries, which provide idiomatic Python interfaces to CPL and HDRL while allowing users to take advantage of the scientific Python ecosystem. PyCPL and PyHDRL are already being used to prototype recipes for the MAVIS instrument pipeline, and have been used to develop an extensible pipeline development framework. Here we describe their design, implementation and usage.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] NICI Python']Python Data Reduction
    Zarate, Nelson
    Artigua, Etienne
    Hartung, Markus
    Labrie, Kathleen
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XIX, 2010, 434 : 481 - +
  • [2] Bioinformatic pipelines in Python']Python with Leaf
    Napolitano, Francesco
    Mariani-Costantini, Renato
    Tagliaferri, Roberto
    BMC BIOINFORMATICS, 2013, 14
  • [3] Crates and Transform: Python']Python Interfaces for Data Analysis
    Lyn, Janine
    Cresitello-Dittmar, Mark
    Evans, Ian
    Evans, Janet DePonte
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXIII, 2014, 485 : 339 - 342
  • [4] Python']Python interfaces for the Smoldyn simulator
    Singh, Dilawar
    Andrews, Steven S.
    BIOINFORMATICS, 2022, 38 (01) : 291 - 293
  • [6] GPUs and Python']Python: A Recipe for Lightning-Fast Data Pipelines
    Warner, C.
    Packham, C.
    Eikenberry, S. S.
    Gonzalez, A.
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXI, 2012, 461 : 53 - 56
  • [7] Structure Analysis of Protein Data Bank Using Python']Python Libraries
    Tariq, Tayyaba
    Frezund, Javed
    Farhan, Muhammad
    Latif, Rana M. Amir
    Mehmood, Azka
    PROCEEDINGS OF 2020 17TH INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGY (IBCAST), 2020, : 201 - 209
  • [8] PyHTK: PYTHON']PYTHON LIBRARY AND ASR PIPELINES FOR HTK
    Zhang, C.
    Kreyssig, F. L.
    Li, Q.
    Woodland, P. C.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6470 - 6474
  • [9] Ruffus: a lightweight Python']Python library for computational pipelines
    Goodstadt, Leo
    BIOINFORMATICS, 2010, 26 (21) : 2778 - 2779
  • [10] naplib-python']python: Neural acoustic data processing and analysis tools in python']python
    Mischler, Gavin
    Raghavan, Vinay
    Keshishian, Menoua
    Mesgarani, Nima
    SOFTWARE IMPACTS, 2023, 17