Elastic Stream Processing for the Internet of Things

被引:0
|
作者
Hochreiner, Christoph [1 ]
Vogler, Michael [1 ]
Schulte, Stefan [1 ]
Dustdar, Schahram [1 ]
机构
[1] TU Wien, Distributed Syst Grp, Vienna, Austria
基金
欧盟地平线“2020”;
关键词
Stream processing; Distributed data processing; Hybrid clouds;
D O I
10.1109/CLOUD.2016.21
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Emerging trends like Big Data and the Internet of Things pose new challenges to established data stream processing engines. Especially, with the advent of the Internet of Things, the data that has to be processed can become very large. Since companies usually aim for cost efficiency, engines need to support resource elasticity to minimize the operational cost while maintaining real-time processing capabilities. In the work at hand, we propose and realize the distributed Platform for Elastic Stream Processing ( PESP). An extensive evaluation demonstrates the practical feasibility and efficiency of the system design. The evaluation shows that PESP is able to reduce cost by 20% with minimal effects on the Quality of Service in comparison to an over-provisioning baseline. Compared to an under-provisioning baseline, PESP allows a Quality of Service improvement of 72%.
引用
收藏
页码:100 / 107
页数:8
相关论文
共 50 条
  • [11] Signal Processing and the Internet of Things
    Xu, Chenren
    Sun, Yan
    Plataniotis, Konstantinos N.
    Lane, Nic
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (05) : 13 - 15
  • [12] Elastic stream processing in the Cloud
    Hummer, Waldemar
    Satzger, Benjamin
    Dustdar, Schahram
    [J]. WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2013, 3 (05) : 333 - 345
  • [13] A Real-time and Energy-aware Framework for Data Stream Processing in the Internet of Things
    de Oliveira, Egberto R.
    Delicato, Flavia
    da Rocha, Atslands R.
    Mattoso, Marta
    [J]. PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS, BIG DATA AND SECURITY (IOTBDS), 2021, : 17 - 28
  • [14] Reliable stream data processing for elastic distributed stream processing systems
    Xiaohui Wei
    Yuan Zhuang
    Hongliang Li
    Zhiliang Liu
    [J]. Cluster Computing, 2020, 23 : 555 - 574
  • [15] Reliable stream data processing for elastic distributed stream processing systems
    Wei, Xiaohui
    Zhuang, Yuan
    Li, Hongliang
    Liu, Zhiliang
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2020, 23 (02): : 555 - 574
  • [16] Internet of things: Cotton harvesting and processing
    Hardin IV, Robert G.
    Barnes, Edward M.
    Delhom, Christopher D.
    Wanjura, John D.
    Ward, Jason K.
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 202
  • [17] A Personal Analytics Platform for the Internet of Things Implementing Kappa Architecture with Microservice-based Stream Processing
    Zschoernig, Theo
    Wehlitz, Robert
    Franczyk, Bogdan
    [J]. ICEIS: PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS - VOL 2, 2017, : 733 - 738
  • [18] Elastic Stateful Stream Processing in Storm
    Cardellini, Valeria
    Nardelli, Matted
    Luzi, Dario
    [J]. 2016 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS 2016), 2016, : 583 - 590
  • [19] Applications of Stream Data Mining on The Internet of Things: A Survey
    Guler, Emine Rumeysa
    Ozdemir, Suat
    [J]. 2018 INTERNATIONAL CONGRESS ON BIG DATA, DEEP LEARNING AND FIGHTING CYBER TERRORISM (IBIGDELFT), 2018, : 51 - 55
  • [20] Elastic Stream Processing for Distributed Environments
    Hochreiner, Christoph
    Schulte, Stefan
    Dustdar, Schahram
    Lecue, Freddy
    [J]. IEEE INTERNET COMPUTING, 2015, 19 (06) : 54 - 59