Software Systems for Processing and Analysis of Big Data and Event Streams

被引:0
|
作者
Stojnev, Aleksandra I. [1 ]
Stojanovic, Dragan H. [1 ]
机构
[1] Univ Nis, Fac Elect Engn, Aleksandra Medvedeva 14, Nish 18000, Serbia
关键词
Big data; Stream processing and analysis; Storm; Spark; Flink; FRAMEWORK;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advances in sensor technologies, mobile positioning, IoT and wireless communications have led to development of applications for data collection, processing, analysis, mining and visualization for the purposes of real time responses and decision support, but have also brought new challenges to processing large amount of data in a real time. Various software systems are developed to provide a set of methods, technologies, algorithms and index structures for effective monitoring, processing, analysis and mining of continuous flow of data and events. This paper reviews recent developments in the field of data streams processing and analysis, gives an overview of existing systems and technologies, and demonstrates development of a stream processing application based on the contemporary stream processing frameworks.
引用
收藏
页码:128 / 131
页数:4
相关论文
共 50 条
  • [31] Processing and Analytics of Big Data Streams with Yahoo!S4
    Xhafa, Fatos
    Naranjo, Victor
    Caballe, Santi
    [J]. 2015 IEEE 29th International Conference on Advanced Information Networking and Applications (IEEE AINA 2015), 2015, : 263 - 270
  • [32] Processing Big Trajectory and Twitter Data Streams using Apache STORM
    Stojanovic, Dragan
    Stojanovic, Natalija
    Turanjanin, Jovan
    [J]. 2015 12TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS IN MODERN SATELLITE, CABLE AND BROADCASTING SERVICES (TELSIKS), 2015, : 301 - 304
  • [33] Efficient resource scheduling for the analysis of Big Data streams
    Mortazavi-Dehkordi, Mahmood
    Zamanifar, Kamran
    [J]. INTELLIGENT DATA ANALYSIS, 2019, 23 (01) : 77 - 102
  • [34] Hidden Markov Models for Abnormal Event Processing in Transportation Data Streams
    Lau, John Kah-Soon
    Tham, Chen-Khong
    [J]. PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 816 - 821
  • [35] Bonsai: an event-based framework for processing and controlling data streams
    Lopes, Goncalo
    Bonacchi, Niccolo
    Frazao, Joao
    Neto, Joana P.
    Atallah, Bassam V.
    Soares, Sofia
    Moreira, Luis
    Matias, Sara
    Itskov, Pavel M.
    Correia, Patricia A.
    Medina, Roberto E.
    Calcaterra, Lorenza
    Dreosti, Elena
    Paton, Joseph J.
    Kampff, Adam R.
    [J]. FRONTIERS IN NEUROINFORMATICS, 2015, 9
  • [36] Complex Event Processing on Uncertain Data Streams in Product Manufacturing Process
    Mao, Na
    Tan, Jie
    [J]. 2015 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2015, : 583 - 588
  • [37] A Modular Fuzzy Expert System Architecture for Data and Event Streams Processing
    Poli, Jean-Philippe
    Boudet, Laurence
    [J]. INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, IPMU 2016, PT II, 2016, 611 : 717 - 728
  • [38] Semantics-based complex event processing for RFID data streams
    Ku, Tao
    Zhu, YunLong
    Hu, KunYuan
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL SYMPOSIUM ON DATA, PRIVACY, AND E-COMMERCE, 2007, : 32 - 34
  • [39] Big Data Analysis for Event Detection in Microblogs
    Cherichi, Soumaya
    Faiz, Rim
    [J]. RECENT DEVELOPMENTS IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, 2016, 642 : 309 - 319
  • [40] The Pan-STARRS Data Processing and Science Analysis Software Systems
    Heasley, J. N.
    [J]. CLASSIFICATION AND DISCOVERY IN LARGE ASTRONOMICAL SURVEYS, 2008, 1082 : 352 - 358