Python']Python and pipelines: Python']Python interfaces for ESO's CPL & HDRL data reduction libraries

被引:0
|
作者
Horton, Anthony [1 ]
Heng, Anthony [1 ]
Farrell, Aidan [1 ]
Deshpande, Mrunmayi [1 ]
Miszalski, Brent [1 ]
Fernando, Nuwanthika [1 ]
Lorente, Nuria [1 ]
Palsa, Ralf [2 ]
Lundin, Lars [2 ]
Gabasch, Armin [2 ]
机构
[1] Macquarie Univ, Australian Astron Opt, Sydney, NSW, Australia
[2] European Southern Observ, Karl Schwarzschild Str 2, Garching, Germany
关键词
PyCPL; PyHDRL; CPL; HDRL; data reduction pipeline; !text type='Python']Python[!/text] bindings; pybind11; scientific [!text type='Python']Python[!/text;
D O I
10.1117/12.3019678
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
The ESO Common Pipeline Library (CPL) and High Level Data Reduction Library (HDRL) together form a comprehensive, efficient and robust software toolkit for data reduction pipelines. They were developed in C for reasons of efficiency and speed, however, with the community's preference towards Python for algorithm prototyping and data reduction, there is a need for access from Python. PyCPL and PyHDRL provide this, making it possible to run existing CPL data reduction recipes from Python as well as developing new recipes in Python. These new recipes are built using the PyCPL and PyHDRL libraries, which provide idiomatic Python interfaces to CPL and HDRL while allowing users to take advantage of the scientific Python ecosystem. PyCPL and PyHDRL are already being used to prototype recipes for the MAVIS instrument pipeline, and have been used to develop an extensible pipeline development framework. Here we describe their design, implementation and usage.
引用
收藏
页数:4
相关论文
共 50 条
  • [21] What's Wrong, Python']Python? - A Visual Differ and Graph Library for NLP in Python']Python
    Indig, Balazs
    Simonyi, Andras
    Ligeti-Nagy, Noemi
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), 2018, : 577 - 582
  • [22] Reduction of blood oxygen levels enhances postprandial cardiac hypertrophy in Burmese python']python (Python']Python bivittatus)
    Slay, Christopher E.
    Enok, Sanne
    Hicks, James W.
    Wang, Tobias
    JOURNAL OF EXPERIMENTAL BIOLOGY, 2014, 217 (10): : 1784 - 1789
  • [23] Python']Python's hearty meal
    Stecyk, JAW
    JOURNAL OF EXPERIMENTAL BIOLOGY, 2005, 208 (17): : VI - VI
  • [24] Dedenser: A Python']Python Package for Clustering and Downsampling Chemical Libraries
    Beck, Armen G.
    Fine, Jonathan
    Lam, Yu-hong
    Sherer, Edward C.
    Regalado, Erik L.
    Aggarwal, Pankaj
    JOURNAL OF CHEMICAL INFORMATION AND MODELING, 2025, 65 (03) : 1053 - 1060
  • [25] Stimfit: quantifying electrophysiological data with Python']Python
    Guzman, Segundo J.
    Schlogl, Alois
    Schmidt-Hieber, Christoph
    FRONTIERS IN NEUROINFORMATICS, 2014, 8
  • [26] Geophysical data analysis using Python']Python
    Sáenz, J
    Zubillaga, J
    Fernández, J
    COMPUTERS & GEOSCIENCES, 2002, 28 (04) : 457 - 465
  • [27] Python']Python and R for the Modern Data Scientist
    Lortie, Christopher J.
    JOURNAL OF STATISTICAL SOFTWARE, 2022, 103 (BR2): : 1 - 4
  • [28] Tasrif: processing wearable data in Python']Python
    Al Homaid, Abdulaziz
    Hashim, Syed
    Abubaker, Fadhil
    Abbas, Ummar
    Farooq, Faisal
    Palotti, Joao
    2022 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS AND OTHER AFFILIATED EVENTS (PERCOM WORKSHOPS), 2022,
  • [29] PRMS-Python']Python: A Python']Python framework for programmatic PRMS modeling and access to its data structures
    Volk, John M.
    Turner, Matthew A.
    ENVIRONMENTAL MODELLING & SOFTWARE, 2019, 114 : 152 - 165
  • [30] Toward Efficient Interactions between Python']Python and Native Libraries
    Tan, Jialiang
    Chen, Yu
    Liu, Zhenming
    Ren, Bin
    Song, Shuaiwen Leon
    Shen, Xipeng
    Liu, Xu
    PROCEEDINGS OF THE 29TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '21), 2021, : 1117 - 1128