Data pipeline for managing field experiments

被引:2
|
作者
Liu, Jian [1 ]
Cichota, Rogerio [1 ]
Langer, Stephanie [1 ]
Burgueno, Eric [1 ]
Michel, Alexandre [1 ]
机构
[1] New Zealand Inst Plant & Food Res Ltd, Auckland, New Zealand
关键词
Real-time visualisation; Experiment management; Data streamlining; BIG DATA;
D O I
10.1016/j.mex.2023.102031
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
As agricultural and environmental research projects become more complex, increasingly with multiple outcomes, the demand for technical support with experiment management and data handling has also increased. Interactive visualisation solutions are user-friendly and provide direct information to facilitate decision making with timely data interpretation. Existing off-the-shelf tools can be expensive and require a specialist to conduct the development of visualisation solutions. We used open-source software to develop a customised near real-time interactive dashboard system to support science experiment decision making. Our customisation allowed for: center dot Digitalised domain knowledge via open-source solutions to develop decision support systems. center dot Automated workflow that only executed the necessary components. center dot Modularised solutions for low maintenance cost and upgrades.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Managing big data experiments on smartphones
    Larkou, Georgios
    Mintzis, Marios
    Andreou, Panayiotis G.
    Konstantinidis, Andreas
    Zeinalipour-Yazti, Demetrios
    DISTRIBUTED AND PARALLEL DATABASES, 2016, 34 (01) : 33 - 64
  • [2] MANAGING DATA FROM COMBINATORIAL EXPERIMENTS
    BLANEY, JM
    CIANI, MA
    WEININGER, D
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 1994, 208 : 122 - COMP
  • [3] Managing big data experiments on smartphones
    Georgios Larkou
    Marios Mintzis
    Panayiotis G. Andreou
    Andreas Konstantinidis
    Demetrios Zeinalipour-Yazti
    Distributed and Parallel Databases, 2016, 34 : 33 - 64
  • [4] An informatic pipeline for managing high-throughput screening experiments and analyzing data from stereochemically diverse libraries
    Mulrooney, Carol A.
    Lahr, David L.
    Quintin, Michael J.
    Youngsaye, Willmen
    Moccia, Dennis
    Asiedu, Jacob K.
    Mulligan, Evan L.
    Akella, Lakshmi B.
    Marcaurelle, Lisa A.
    Montgomery, Philip
    Bittker, Joshua A.
    Clemons, Paul A.
    Brudz, Stephen
    Dandapani, Sivaraman
    Duvall, Jeremy R.
    Tolliday, Nicola J.
    De Souza, Andrea
    JOURNAL OF COMPUTER-AIDED MOLECULAR DESIGN, 2013, 27 (05) : 455 - 468
  • [5] An informatic pipeline for managing high-throughput screening experiments and analyzing data from stereochemically diverse libraries
    Carol A. Mulrooney
    David L. Lahr
    Michael J. Quintin
    Willmen Youngsaye
    Dennis Moccia
    Jacob K. Asiedu
    Evan L. Mulligan
    Lakshmi B. Akella
    Lisa A. Marcaurelle
    Philip Montgomery
    Joshua A. Bittker
    Paul A. Clemons
    Stephen Brudz
    Sivaraman Dandapani
    Jeremy R. Duvall
    Nicola J. Tolliday
    Andrea De Souza
    Journal of Computer-Aided Molecular Design, 2013, 27 : 455 - 468
  • [6] EXPERIMENTS WITH FIELD DATA
    TOMAN, W
    PSYCHOLOGIE IN ERZIEHUNG UND UNTERRICHT, 1976, 23 (02): : 80 - 90
  • [7] PIPELINE INTEGRITY DATA: MANAGING PAST, PRESENT, FUTURE
    Porter, Todd
    Donaho, Darrell
    PROCEEDINGS OF THE 10TH INTERNATIONAL PIPELINE CONFERENCE - 2014, VOL 2, 2014,
  • [8] Tango Controls and data pipeline for petawatt laser experiments
    Nils Wei?e
    Leonard Doyle
    Johannes Gebhard
    Felix Balling
    Florian Schweiger
    Florian Haberstroh
    Laura D.Geulig
    Jinpu Lin
    Faran Irshad
    Jannik Esslinger
    Sonja Gerlach
    Max Gilljohann
    Vignesh Vaidyanathan
    Dennis Siebert
    Andreas Münzer
    Gregor Schilling
    J?rg Schreiber
    Peter G.Thirolf
    Stefan Karsch
    Andreas D?pp
    High Power Laser Science and Engineering, 2023, 11 (04) : 6 - 12
  • [9] Tango Controls and data pipeline for petawatt laser experiments
    Weisse, Nils
    Doyle, Leonard
    Gebhard, Johannes
    Balling, Felix
    Schweiger, Florian
    Haberstroh, Florian
    Geulig, Laura D.
    Lin, Jinpu
    Irshad, Faran
    Esslinger, Jannik
    Gerlach, Sonja
    Gilljohann, Max
    Vaidyanathan, Vignesh
    Siebert, Dennis
    Muenzer, Andreas
    Schilling, Gregor
    Schreiber, Joerg
    Thirolf, Peter G.
    Karsch, Stefan
    Doepp, Andreas
    HIGH POWER LASER SCIENCE AND ENGINEERING, 2023, 11
  • [10] Aberrant data in field experiments
    Dyke, GV
    Pearce, SC
    EXPERIMENTAL AGRICULTURE, 2000, 36 (03) : 343 - 351