Software Systems for Processing and Analysis of Big Data and Event Streams

被引:0
|
作者
Stojnev, Aleksandra I. [1 ]
Stojanovic, Dragan H. [1 ]
机构
[1] Univ Nis, Fac Elect Engn, Aleksandra Medvedeva 14, Nish 18000, Serbia
关键词
Big data; Stream processing and analysis; Storm; Spark; Flink; FRAMEWORK;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advances in sensor technologies, mobile positioning, IoT and wireless communications have led to development of applications for data collection, processing, analysis, mining and visualization for the purposes of real time responses and decision support, but have also brought new challenges to processing large amount of data in a real time. Various software systems are developed to provide a set of methods, technologies, algorithms and index structures for effective monitoring, processing, analysis and mining of continuous flow of data and events. This paper reviews recent developments in the field of data streams processing and analysis, gives an overview of existing systems and technologies, and demonstrates development of a stream processing application based on the contemporary stream processing frameworks.
引用
收藏
页码:128 / 131
页数:4
相关论文
共 50 条
  • [1] Parallel Processing Data Streams in Complex Event Processing Systems
    Xiao, Fuyuan
    Zhan, Cheng
    Lai, Hong
    Tao, Li
    [J]. 2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 6157 - 6160
  • [2] A Review on Complex Event Processing Systems for Big Data
    Tawsif, K.
    Hossen, J.
    Raja, J. Emerson
    Jesmeen, M. Z. H.
    Arif, E. M. H.
    [J]. 2018 FOURTH INTERNATIONAL CONFERENCE ON INFORMATION RETRIEVAL AND KNOWLEDGE MANAGEMENT (CAMP), 2018, : 2 - 7
  • [3] New parallel processing strategies in complex event processing systems with data streams
    Xiao, Fuyuan
    Zhan, Cheng
    Lai, Hong
    Tao, Li
    Qu, Zhiguo
    [J]. INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2017, 13 (08): : 1 - 15
  • [4] Incremental Query Processing on Big Data Streams
    Fegaras, Leonidas
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (11) : 2998 - 3012
  • [5] An Efficient Approach for Storage of Big Data Streams in Distributed Stream Processing Systems
    Alshamrani, Sultan
    Waseem, Quadri
    Alharbi, Abdullah
    Alosaimi, Wael
    Turabieh, Hamza
    Alyami, Hashem
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (05) : 91 - 98
  • [6] Designing Monitoring Systems for Complex Event Processing in Big Data Contexts
    Andrade, Carina
    Cardoso, Maria
    Costa, Carlos
    Santos, Maribel Yasmina
    [J]. INFORMATION SYSTEMS (EMCIS 2021), 2022, 437 : 17 - 30
  • [7] Architecture of Processing and Analysis Systems for Big Astronomical Data
    Kolosov, Ivan
    Gerasimov, Sergey
    Meshcheryakov, Alexander
    [J]. ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXVI, 2019, 521 : 428 - 430
  • [8] Boosting Heapsort Performance of Processing Big Data Streams
    Algemili, Usamah
    Alhudhaif, Adi
    [J]. SOUTHEASTCON 2016, 2016,
  • [9] Composite Event Processing for Data Streams and Domain Knowledge
    Liu, Junqiang
    Guan, Xiaoling
    [J]. ADVANCED RESEARCH ON INFORMATION SCIENCE, AUTOMATION AND MATERIAL SYSTEM, PTS 1-6, 2011, 219-220 : 927 - 931
  • [10] Partitioning for Scalable Complex Event Processing on Data Streams
    Saleh, Omran
    Betz, Heiko
    Sattler, Kai-Uwe
    [J]. NEW TRENDS IN DATABASE AND INFORMATION SYSTEMS II, 2015, 312 : 185 - 197