Running the Sloan Digital Sky Survey data archive server

被引:0
|
作者
Neilsen, Eric H., Jr. [1 ]
Stoughton, Chris [1 ]
机构
[1] Fermilab Natl Accelerator Lab, POB 500, Batavia, IL 60510 USA
关键词
D O I
暂无
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
The Sloan Digital Sky Survey (SDSS) Data Archive Server (DAS) provides public access to over 12 Tb of data in 17 million files produced by the SDSS data reduction pipeline. Many tasks that seem trivial when serving smaller, less complex data sets present challenges when serving data of this volume and technical complexity. The included output files should be chosen to support as much science as possible from publicly released data, and only publicly released data. Users must have the resources needed to read and interpret the data correctly. Server administrators must generate new data releases at regular intervals, monitor usage, quickly recover from hardware failures, and monitor the data served by the DAS both for content and corruption. We discuss these challenges, describe tools we use to administer and support the DAS, and discuss future development plans.
引用
收藏
页码:42 / +
页数:2
相关论文
共 50 条
  • [1] The Sloan Digital Sky Survey - Data Archive Server
    Neilsen, Eric H., Jr.
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2008, 10 (01) : 13 - 17
  • [2] The science archive for the Sloan Digital Sky Survey
    Brunner, RJ
    Csabai, I
    Szalay, A
    Connolly, AJ
    Szokoly, GP
    Ramaiyer, K
    [J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS V, 1996, 101 : 493 - 496
  • [3] The Sloan Digital Sky Survey and its archive
    Szalay, AS
    Kunszt, P
    Thakar, A
    Gray, J
    Slutz, D
    [J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS IX, 2000, 216 : 405 - 414
  • [4] Using Sloan Digital Sky Survey data in the classroom
    Sparks, R
    Stoughton, C
    Raddick, MJ
    [J]. NASA OFFICE OF SPACE SCIENCE EDUCATION AND PUBLIC OUTREACH CONFERENCE, 2004, 319 : 394 - 396
  • [5] The second data release of the Sloan Digital Sky Survey
    Abazajian, K
    Adelman-McCarthy, JK
    Agüeros, MA
    Allam, SS
    Kurt
    Anderson, SJ
    Anderson, SF
    Annis, J
    Bahcall, NA
    Baldry, IK
    Bastian, S
    Berlind, A
    Bernardi, M
    Blanton, MR
    Bochanski, JJ
    Boroski, WN
    Briggs, JW
    Brinkmann, J
    Brunner, RJ
    Budavári, T
    Carey, LN
    Carliles, S
    Castander, FJ
    Connolly, AJ
    Csabai, I
    Doi, M
    Dong, F
    Eisenstein, DJ
    Evans, ML
    Fan, XH
    Finkbeiner, DP
    Friedman, SD
    Frieman, JA
    Fukugita, M
    Gal, RR
    Gillespie, B
    Glazebrook, K
    Gray, J
    Grebel, EK
    Gunn, JE
    Gurbani, VK
    Hall, PB
    Hamabe, M
    Harris, FH
    Harris, HC
    Harvanek, M
    Heckman, TM
    Hendry, JS
    Hennessy, GS
    Hindsley, RB
    [J]. ASTRONOMICAL JOURNAL, 2004, 128 (01): : 502 - 512
  • [6] The Sloan Digital Sky Survey
    Strauss, MA
    Knapp, GR
    Lupton, RH
    Gunn, JE
    Ivezic, Z
    Carr, M
    Fan, XH
    Vogeley, MS
    [J]. ASTROPHYSICS WITH INFRARED SURVEYS: A PRELUDE TO SIRTF, 1999, 177 : 390 - 393
  • [7] The Sloan Digital Sky Survey
    Szalay, AS
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 1999, 1 (02) : 54 - 62
  • [8] Sloan Digital Sky Survey:: Early data release
    Stoughton, C
    Lupton, RH
    Bernardi, M
    Blanton, MR
    Burles, S
    Castander, FJ
    Connolly, AJ
    Eisenstein, DJ
    Frieman, JA
    Hennessy, GS
    Hindsley, RB
    Ivezic, Z
    Kent, S
    Kunszt, PZ
    Lee, BC
    Meiksin, A
    Munn, JA
    Newberg, HJ
    Nichol, RC
    Nicinski, T
    Pier, JR
    Richards, GT
    Richmond, MW
    Schlegel, DJ
    Smith, JA
    Strauss, MA
    SubbaRao, M
    Szalay, AS
    Thakar, AR
    Tucker, DL
    Vanden Berk, DE
    Yanny, B
    Adelman, JK
    Anderson, JE
    Anderson, SF
    Annis, J
    Bahcall, NA
    Bakken, JA
    Bartelmann, M
    Bastian, S
    Bauer, A
    Berman, E
    Böhringer, H
    Boroski, WN
    Bracker, S
    Briegel, C
    Briggs, JW
    Brinkmann, J
    Brunner, R
    Carey, L
    [J]. ASTRONOMICAL JOURNAL, 2002, 123 (01): : 485 - 548
  • [9] The Sixth Data Release of the Sloan Digital Sky Survey
    Adelman-McCarthy, Jennifer K.
    Agueros, Marcel A.
    Allam, Sahar S.
    Prieto, Carlos Allende
    Anderson, Kurt S. J.
    Anderson, Scott F.
    Annis, James
    Bahcall, Neta A.
    Bailer-Jones, C. A. L.
    Baldry, Ivan K.
    Barentine, J. C.
    Bassett, Bruce A.
    Becker, Andrew C.
    Beers, Timothy C.
    Bell, Eric F.
    Berlind, Andreas A.
    Bernardi, Mariangela
    Blanton, Michael R.
    Bochanski, John J.
    Boroski, William N.
    Brinchmann, Jarle
    Brinkmann, J.
    Brunner, Robert J.
    Budavari, Tamas
    Carliles, Samuel
    Carr, Michael A.
    Castander, Francisco J.
    Cinabro, David
    Cool, R. J.
    Covey, Kevin R.
    Csabai, Istvan
    Cunha, Carlos E.
    Davenport, James R. A.
    Dilday, Ben
    Doi, Mamoru
    Eisenstein, Daniel J.
    Evans, Michael L.
    Fan, Xiaohui
    Finkbeiner, Douglas P.
    Friedman, Scott D.
    Frieman, Joshua A.
    Fukugita, Masataka
    Gansicke, Boris T.
    Gates, Evalyn
    Gillespie, Bruce
    Glazebrook, Karl
    Gray, Jim
    Grebel, Eva K.
    Gunn, James E.
    Gurbani, Vijay K.
    [J]. ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2008, 175 (02): : 297 - 313
  • [10] The Sloan Digital Sky Survey Data Transfer Infrastructure
    Weaver, Benjamin A.
    Blanton, Michael R.
    Brinkmann, Jon
    Brownstein, Joel R.
    Stauffer, Fritz
    [J]. PUBLICATIONS OF THE ASTRONOMICAL SOCIETY OF THE PACIFIC, 2015, 127 (950) : 397 - 405