Data pipeline for managing field experiments

被引:2
|
作者
Liu, Jian [1 ]
Cichota, Rogerio [1 ]
Langer, Stephanie [1 ]
Burgueno, Eric [1 ]
Michel, Alexandre [1 ]
机构
[1] New Zealand Inst Plant & Food Res Ltd, Auckland, New Zealand
关键词
Real-time visualisation; Experiment management; Data streamlining; BIG DATA;
D O I
10.1016/j.mex.2023.102031
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
As agricultural and environmental research projects become more complex, increasingly with multiple outcomes, the demand for technical support with experiment management and data handling has also increased. Interactive visualisation solutions are user-friendly and provide direct information to facilitate decision making with timely data interpretation. Existing off-the-shelf tools can be expensive and require a specialist to conduct the development of visualisation solutions. We used open-source software to develop a customised near real-time interactive dashboard system to support science experiment decision making. Our customisation allowed for: center dot Digitalised domain knowledge via open-source solutions to develop decision support systems. center dot Automated workflow that only executed the necessary components. center dot Modularised solutions for low maintenance cost and upgrades.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] A fully automated data reduction pipeline for the FRODOSpec integral field spectrograph
    Barnsley, R. M.
    Smith, R. J.
    Steele, I. A.
    ASTRONOMISCHE NACHRICHTEN, 2012, 333 (02) : 101 - 117
  • [42] PyWiFeS: a rapid data reduction pipeline for the Wide Field Spectrograph (WiFeS)
    Michael J. Childress
    Frédéric P. A. Vogt
    Jon Nielsen
    Robert G. Sharp
    Astrophysics and Space Science, 2014, 349 : 617 - 636
  • [43] PyWiFeS: a rapid data reduction pipeline for the Wide Field Spectrograph (WiFeS)
    Childress, Michael J.
    Vogt, Frederic P. A.
    Nielsen, Jon
    Sharp, Robert G.
    ASTROPHYSICS AND SPACE SCIENCE, 2014, 349 (02) : 617 - 636
  • [44] Data pipeline
    ABB Management Services Ltd., Zürich, Switzerland
    不详
    不详
    ABB Rev, 2006, 4 (26-29):
  • [45] Experiments with sediment replenishment in a residual flow reach: Comparison of field data with laboratory experiments
    Stahly, Severin
    Maitre, Anthony
    Franca, Mario J.
    Robinson, Christopher T.
    Schleiss, Anton J.
    NINTH INTERNATIONAL CONFERENCE ON FLUVIAL HYDRAULICS (RIVER FLOW 2018), 2018, 40
  • [46] Managing Nationalism: Experiments in China
    Quek, Kai
    Chan, Samuel S. H.
    JOURNAL OF CONFLICT RESOLUTION, 2024,
  • [47] Reflectivity inversion for attenuated seismic data: Physical modeling and field data experiments
    Chai, Xintao
    Wang, Shangxu
    Wei, Jianxin
    Li, Jingnan
    Yin, Hanjun
    GEOPHYSICS, 2016, 81 (01) : T11 - T24
  • [48] Managing Pressure while Pigging an Oil Pipeline
    Hosseini, Seyedamir
    CHEMICAL ENGINEERING, 2012, 119 (13) : 40 - 41
  • [49] Managing pressure while pigging an oil pipeline
    Hosseini, Seyedamir
    Masoudi, Hamidreza
    Chemical Engineering (United States), 2012, 119 (12): : 40 - 41
  • [50] From field station to forecast: managing data at the Alaska Volcano Observatory
    Coombs, Michelle L.
    Cameron, Cheryl E.
    Dietterich, Hannah R.
    Boyce, Eleanor S.
    Wech, Aaron G.
    Grapenthin, Ronni
    Wallace, Kristi L.
    Parker, Tom
    Lopez, Taryn
    Crass, Scott
    Fee, David
    Haney, Matthew M.
    Ketner, Dane
    Loewen, Matthew W.
    Lyons, John J.
    Nakai, Jenny S.
    Power, John A.
    Botnick, Steven
    Brewster, Israel
    Enders, Max L.
    Harmon, Dain
    Kelly, Peter J.
    Randall, Michael
    BULLETIN OF VOLCANOLOGY, 2024, 86 (09)