Design of LAMOST data processing and production database

被引:0
|
作者
Guo, Yanxin [1 ]
Luo, Ali [1 ]
Wang, Fengfei [1 ]
Bai, Zhongrui [1 ]
Li, Jian [1 ]
机构
[1] Chinese Acad Sci, NAOC, Natl Astron Observ, Key Lab Opt Astron, Beijing 10012, Peoples R China
关键词
LAMOST; astronomical databases; eyeball check; data flow;
D O I
10.1117/12.925959
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Before LAMOST spectra release, raw data need to go through a series of processes, i.e. a pipeline after observed, including 2D reduction, spectral analysis, eyeball identification. It is a proper strategy that utilizing a database to integrate them. By using database the coupling between relative modules would be reduced to make the adding or removing of them more convenient, and the dataflow seems to be more clearly. The information of a specific object, from target selection to intermediate results and spectrum production, can be efficiently accessed and traced back through the database search, rather than via FITS reading. Furthermore, since the pipeline has not been perfected yet, the eyeball check is needed before the spectra are released, and an appropriate database can make the feedback period of eyeball check result more conveniently, thus the improvement of the pipeline will be more purposely. Finally, database can be a data mining tools for the statistics and analysis of massive astronomical data. This article focuses on the database design and the data processing flow built on it for LAMOST. The database design requirement of the existing routines, such as input/output, the relationship or dependence between them is introduced. Accordingly, the database structure suited for multiple version data process and eyeball verification is presented. The dataflow, how the pipeline is integrated relied on such a dedicated database system and how it worked are also explained. In addition, some user interfaces, eyeball check interfaces, statistical functions are also presented.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Design and Analysis of a Relational Database for Behavioral Experiments Data Processing
    Kraleva, Radoslava
    Kralev, Velin
    Sinyagina, Nina
    Koprinkova-Hristova, Petia
    Bocheva, Nadejda
    INTERNATIONAL JOURNAL OF ONLINE ENGINEERING, 2018, 14 (02) : 117 - 132
  • [2] Design of data management for real-time database in processing industry
    Wang, Cheng-Guang
    Su, Hong-Ye
    Chu, Jian
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2003, 37 (02): : 134 - 138
  • [3] Distributed processing for database design
    Char, J.M.
    Cherkassky, V.
    Wechsler, H.
    Neural Networks, 1988, 1 (1 SUPPL)
  • [4] The Data Processing of the LAMOST Medium-resolution Spectral Survey of Galactic Nebulae(LAMOST MRS-N Pipeline)
    Chao-Jian Wu
    Hong Wu
    Wei Zhang
    Yao Li
    Juan-Juan Ren
    Jian-Jun Chen
    Chih-Hao Hsia
    Yu-Zhong Wu
    Hui Zhu
    Bin Li
    Yong-Hui Hou
    Research in Astronomy and Astrophysics, 2022, 22 (07) : 226 - 236
  • [5] The Data Processing of the LAMOST Medium-resolution Spectral Survey of Galactic Nebulae (LAMOST MRS-N Pipeline)
    Wu, Chao-Jian
    Wu, Hong
    Zhang, Wei
    Li, Yao
    Ren, Juan-Juan
    Chen, Jian-Jun
    Hsia, Chih-Hao
    Wu, Yu-Zhong
    Zhu, Hui
    Li, Bin
    Hou, Yong-Hui
    RESEARCH IN ASTRONOMY AND ASTROPHYSICS, 2022, 22 (07)
  • [6] Application of denormalization processing in database design
    Nanjing Youdian Xueyuan Xuebao, 3 (76-80):
  • [7] Near Data Processing in Taurus Database
    Lin, Shu
    Marathe, Arunprasad P.
    Larson, Per-Ake
    Chen, Chong
    Sun, Calvin
    Lee, Paul
    Yu, Weidong
    Li, Jianwei
    Meng, Juncai
    Lin, Roulin
    Chen, Xiaoyang
    Zhu, Qingping
    2022 IEEE 38TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2022), 2022, : 1662 - 1674
  • [8] Database storage and processing of biological data
    Syarki, MT
    PROCEEDINGS OF THE THIRD INTERNATIONAL LAKE LADOGA SYMPOSIUM 1999, 2000, (129): : 460 - 463
  • [9] Data modelling for database design in apple production monitoring systems for a producer organization
    Habib, R
    Nesme, T
    Plénet, D
    Lescourret, F
    INTERNATIONAL SYMPOSIUM ON APPLICATIONS OF MODELLING AS AN INNOVATIVE TECHNOLOGY IN THE AGRI-FOOD-CHAIN - MODEL-IT, 2001, (566): : 477 - 482
  • [10] DATA MODELING FOR DATABASE DESIGN IN PRODUCTION AND HEALTH MONITORING SYSTEMS FOR DAIRY HERDS
    LESCOURRET, F
    GENEST, M
    BARNOUIN, J
    CHASSAGNE, M
    FAYE, B
    JOURNAL OF DAIRY SCIENCE, 1993, 76 (04) : 1053 - 1062