Remote distributed pipeline processing of GONG helloselsmic data: Experience and lessons learned

被引:2
|
作者
Goodrich, J [1 ]
Kholikov, S [1 ]
Lindsey, C [1 ]
Malanushenko, A [1 ]
Shroff, C [1 ]
Toner, C [1 ]
机构
[1] Natl Solar Observ, GONG Program, Tucson, AZ 85719 USA
关键词
farside; helioseismology; GONG; MDI; SOHO; Lindsey and Braun;
D O I
10.1117/12.552085
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
The Global Oscillation Network Group (GONG) helioseismic network can create images of the farside of the Sun which frequently show the presence of large active regions that would be otherwise invisible. This ability to "see" through the sun is of potential benefit to the prediction of solar influences on the Earth, provided that the data can be obtained and reduced in a timely fashion. Thus, GONG is developing a system to A) perform initial data analysis steps at six geographically distributed sites, B) transmit the reduced data to a home station, C) perform the final steps in the analysis, and D) distribute the science products to space weather forecasters. The essential requirements are that the system operate automatically around the clock with little human intervention, and that the science products be available no more than 48 hours after the observations are obtained. We will discuss the design, implementation, testing, and current status of the system.
引用
收藏
页码:538 / 546
页数:9
相关论文
共 50 条
  • [41] A Cluster-Based Partition Method of Remote Sensing Data for Efficient Distributed Image Processing
    Wang, Lei
    Yu, Bo
    Chen, Fang
    Li, Congrong
    Li, Bin
    Wang, Ning
    REMOTE SENSING, 2022, 14 (19)
  • [42] Lessons Learned in Abruptly Switching from In-Person to Remote Data Collection in Light of the COVID-19 Pandemic
    Walker, Crystal Martin
    Williams, Loretta Alexia
    Bowdre, Trimika L.
    QUALITATIVE REPORT, 2021, 26 (08) : 2382 - 2389
  • [43] Lessons learned in the post-processing of field spectroradiometric data covering the 0.4 to 2.5 μm wavelength region
    Hemmer, TH
    Westphal, TL
    ALGORITHMS FOR MULTISPECTRAL, HYPERSPECTRAL, AND ULTRASPECTRAL IMAGERY VI, 2000, 4049 : 249 - 260
  • [44] Distributed Deep Learning for Big Remote Sensing Data Processing on Apache Spark: Geological Remote Sensing Interpretation as a Case Study
    Long, Ao
    Han, Wei
    Huang, Xiaohui
    Li, Jiabao
    Wang, Yuewei
    Chen, Jia
    WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 96 - 110
  • [45] Lessons learned from naturalistic driving data processing in a secure data enclave: Preliminary discoveries from analyzing dash camera videos
    Mahmood, Kaiser
    Pang, Jiajun
    Ahmed, Sheikh Shahriar
    Yu, Gongda
    Sarwar, Md Tawfiq
    Benedyk, Irina
    Anastasopoulos, Panagiotis Ch.
    TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2024, 106 : 135 - 149
  • [46] BUILDING AND DYNAMICALLY MANAGING WORKFLOWS FOR PROCESSING REMOTE SENSING DATA IN DISTRIBUTED HIGH-THROUGHPUT ENVIRONMENT
    Zheng, Ruobing
    Piao, Yingchao
    Luo, Ze
    Yan, Baoping
    Livny, Miron
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 4368 - 4371
  • [47] Remote Interviewer Training for COVID-19 Data Collection: Challenges and Lessons Learned From 3 Countries in SubSaharan Africa
    Turke, Shani
    Nehrling, Sarah
    Adebayo, Samuel Olanipekun
    Akilimali, Pierre
    Idiodi, Ivan
    Mwangi, Anthony
    Larson, Elizabeth
    Moreau, Caroline
    Anglewicz, Philip
    GLOBAL HEALTH-SCIENCE AND PRACTICE, 2021, 9 (01): : 177 - 186
  • [48] aRNApipe: a balanced, efficient and distributed pipeline for processing RNA-seq data in high-performance computing environments
    Alonso, Arnald
    Lasseigne, Brittany N.
    Williams, Kelly
    Nielsen, Josh
    Ramaker, Ryne C.
    Hardigan, Andrew A.
    Johnston, Bobbi
    Roberts, Brian S.
    Cooper, Sara J.
    Marsal, Sara
    Myers, Richard M.
    BIOINFORMATICS, 2017, 33 (11) : 1727 - 1729
  • [49] A pragmatic evaluation of university student experience of remote digital learning during the COVID-19 pandemic, focusing on lessons learned for future practice
    Brown, Menna
    Hoon, Alice E.
    Edwards, Maisie
    Shabu, Shawn
    Okoronkwo, Imannuella
    Newton, Philip M.
    PLOS ONE, 2023, 18 (05):
  • [50] Lessons learned from the MOMENT study on how to recruit and retain a target population online, across borders, and with automated remote data collection
    Belfiglio, Andrew
    Page, Shayleigh Dickson
    Pettersson, Sara
    van Rijn, Michelle
    Vellone, Ercole
    Westland, Heleen
    Freedland, Kenneth E.
    Lee, Christopher
    Stromberg, Anna
    Wiebe, Douglas
    Aryal, Subhash
    Riegel, Barbara
    Jaarsma, Tiny
    PLOS ONE, 2024, 19 (09):