Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI

被引:228
|
作者
McCully, Curtis [1 ]
Volgenau, Nikolaus H. [1 ]
Harbeck, Daniel-Rolf [1 ]
Lister, Tim A. [1 ]
Saunders, Eric S. [1 ]
Turner, Monica L. [1 ]
Siverd, Robert J. [1 ]
Bowman, Mark [1 ]
机构
[1] Las Cumbres Observ, 6740 Cortona Dr,Suite 102, Goleta, CA 93117 USA
关键词
pipelines; software; image processing;
D O I
10.1117/12.2314340
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Accelerating Real-time LiDAR Data Processing using GPUs
    Venugopal, Vivek
    Kannan, Suresh
    2013 IEEE 56TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2013, : 1168 - 1171
  • [22] NEAR REAL-TIME PROCESSING OF PROTEOMICS DATA USING HADOOP
    Hillman, Chris
    Ahmad, Yasmeen
    Whitehorn, Mark
    Cobley, Andy
    BIG DATA, 2014, 2 (01) : 44 - 49
  • [23] Real-time network data analysis using time series models
    Vafeiadis, Thanasis
    Papanikolaou, Alexandros
    Ilioudis, Christos
    Charchalakis, Stefanos
    SIMULATION MODELLING PRACTICE AND THEORY, 2012, 29 : 173 - 180
  • [24] Near real-time data aggregation using foreign data wrappers from a network of sensors
    Stanisavljevic, Vladimir
    2019 18TH INTERNATIONAL SYMPOSIUM INFOTEH-JAHORINA (INFOTEH), 2019,
  • [25] Parallel processing in real-time ultrasonic imaging
    Nocetti, DFG
    Gonzalez, JS
    Casique, MFV
    Ramirez, RO
    Hernandez, EM
    ALGORITHMS AND ARCHITECTURES FOR REAL-TIME CONTROL 1997, 1997, : 293 - 297
  • [26] REAL-TIME DATA-PROCESSING AND REAL-TIME DECISION-MAKING
    KENNEDY, MH
    HOFFER, JA
    JOURNAL OF SYSTEMS MANAGEMENT, 1978, 29 (10): : 21 - 25
  • [27] Reconfigurable Real-Time Distributed Processing Network
    Page, S. F.
    Seely, R. D.
    Hickman, D.
    GEOSPATIAL INFOFUSION SYSTEMS AND SOLUTIONS FOR DEFENSE AND SECURITY APPLICATIONS, 2011, 8053
  • [28] Real-Time Data Processing for an Advanced Imaging System Using the Xilinx Virtex-5 FPGA
    Werne, Thomas A.
    Bekker, Dmitriy L.
    Pingree, Paula J.
    2010 IEEE AEROSPACE CONFERENCE PROCEEDINGS, 2010,
  • [29] Real-time processing of Mid-wave infrared imaging spectrometer data
    Norton, M
    ALGORITHMS FOR MULTISPECTRAL AND HYPERSPECTRAL IMAGERY II, 1996, 2758 : 320 - 331
  • [30] An efficient solution of real-time data processing for multi-GNSS network
    Gong, Xiaopeng
    Gu, Shengfeng
    Lou, Yidong
    Zheng, Fu
    Ge, Maorong
    Liu, Jingnan
    JOURNAL OF GEODESY, 2018, 92 (07) : 797 - 809