Real-Time processing of proteomics data The internet of things and the connected laboratory

被引:0
|
作者
Hillman, Christopher [1 ]
Petrie, Karen [1 ]
Cobley, Andrew [1 ]
Whitehorn, Mark [1 ]
机构
[1] Univ Dundee, Sch Sci & Engn, Dundee, Scotland
关键词
Tags Flink; Life Sciences; real time; IoT; Cloud; proteomics; mass spectrometry; feature detection; peptides; MASS-SPECTROMETRY; SEARCH;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Processing data from life sciences experiments presents many challenges, these include the volume of data to be processed and the complexity of the processing needed in order to present meaningful results back to the experimenters. This is particularly evident in the field of proteomics where the complex datasets provided by mass spectrometers require extensive pre-processing and the use of search algorithms before they can be used effectively. Many tools currently exist to carry out this processing but they are focused on batch based workloads where the mass spectrometer finishes its analysis and then the data is processed on a file by file basis. Usually this work is carried out on local PC hardware, which can also cause a data management problem. The research described in this paper leads to a distributed cluster-based architecture designed to process the mass spectrometer output in a real-time streaming fashion. In this way the mass spectrometers in a laboratory together with a central computing platform constitute an internet of things problem which can be solved using modern open-source technology and cloud computing.
引用
收藏
页码:2392 / 2399
页数:8
相关论文
共 50 条
  • [1] Research on real-time data processing technology for Internet of things
    Wu, Jia
    Su, Dan
    Liu, Chao
    Lv, Bing
    Ji, ShengPeng
    Li, Xianhui
    Li, Gang
    [J]. PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON MECHATRONICS, MATERIALS, CHEMISTRY AND COMPUTER ENGINEERING 2015 (ICMMCCE 2015), 2015, 39 : 2496 - 2500
  • [2] Real-time intelligent image processing for the internet of things
    Mu-Yen Chen
    Hsin-Te Wu
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 997 - 998
  • [3] Guest Editorial Special Issue on Real-Time Data Processing for Internet of Things
    Bensaali, Faycal
    Zhai, Xiaojun
    Amira, Abbes
    Liu, Lu
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (05): : 3487 - 3490
  • [4] Real-time intelligent image processing for the internet of things
    Chen, Mu-Yen
    Wu, Hsin-Te
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (04) : 997 - 998
  • [5] A Review of Data Gathering Algorithms for Real-Time Processing in Internet of Things Environment
    Kadhim, Atheer A.
    Wahid, Norfaradilla
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (02) : 620 - 629
  • [6] A Real-time and Energy-aware Framework for Data Stream Processing in the Internet of Things
    de Oliveira, Egberto R.
    Delicato, Flavia
    da Rocha, Atslands R.
    Mattoso, Marta
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS, BIG DATA AND SECURITY (IOTBDS), 2021, : 17 - 28
  • [7] Real-Time Data Analysis and Processing and Key Algorithms of the Internet of Things based on Cloud Computing
    Wang, Rongbing
    [J]. AGRO FOOD INDUSTRY HI-TECH, 2017, 28 (01): : 290 - 294
  • [8] Augmented Reality Supported Real-Time Data Processing Using Internet of Things Sensor Technology
    Arntz, Alexander
    Adler, Felix
    Kitzmann, Dennis
    Eimler, Sabrina C.
    [J]. DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS: SMART LIVING, LEARNING, WELL-BEING AND HEALTH, ART AND CREATIVITY, PT II, 2022, 13326 : 3 - 17
  • [9] Real-Time Reliable Internet of Things
    Kalogeraki, Vana
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2018,
  • [10] NEAR REAL-TIME PROCESSING OF PROTEOMICS DATA USING HADOOP
    Hillman, Chris
    Ahmad, Yasmeen
    Whitehorn, Mark
    Cobley, Andy
    [J]. BIG DATA, 2014, 2 (01) : 44 - 49