Time series big data: a survey on data stream frameworks, analysis and algorithms

被引:14
|
作者
Almeida, Ana [1 ,2 ]
Bras, Susana [2 ,3 ]
Sargento, Susana [1 ,2 ]
Pinto, Filipe Cabral [1 ,4 ]
机构
[1] Inst Telecomunicacoes, Aveiro, Portugal
[2] Univ Aveiro, Dept Eletron Telecomunicacoes & Informat, Aveiro, Portugal
[3] Univ Aveiro, IEETA, DETI, LASI, Aveiro, Portugal
[4] Altice Labs, Aveiro, Portugal
关键词
Big data; Time series; Stream processing engines; Forecasting; Anomaly detection; Machine learning; ANOMALY DETECTION; NETWORK;
D O I
10.1186/s40537-023-00760-1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Big data has a substantial role nowadays, and its importance has significantly increased over the last decade. Big data's biggest advantages are providing knowledge, supporting the decision-making process, and improving the use of resources, services, and infrastructures. The potential of big data increases when we apply it in real-time by providing real-time analysis, predictions, and forecasts, among many other applications. Our goal with this article is to provide a viewpoint on how to build a system capable of processing big data in real-time, performing analysis, and applying algorithms. A system should be designed to handle vast amounts of data and provide valuable knowledge through analysis and algorithms. This article explores the current approaches and how they can be used for the real-time operations and predictions.
引用
收藏
页数:32
相关论文
共 50 条
  • [41] Online learning algorithms for big data analytics: A survey
    Li, Zhijie
    Li, Yuanxiang
    Wang, Feng
    He, Guoliang
    Kuang, Li
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2015, 52 (08): : 1707 - 1721
  • [42] A SURVEY OF MACHINE LEARNING ALGORITHMS FOR BIG DATA ANALYTICS
    Athmaja, S.
    Hanumanthappa, M.
    Kavitha, Vasantha
    2017 INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION, EMBEDDED AND COMMUNICATION SYSTEMS (ICIIECS), 2017,
  • [43] Time Series Based Data Explorer and Stream Analysis for Anomaly Prediction
    Yin, Xiao-Xia
    Miao, Yuan
    Zhang, Yanchun
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [44] Real-time analysis and management of big time-series data
    Biem, A.
    Feng, H.
    Riabov, A. V.
    Turaga, D. S.
    IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2013, 57 (3-4)
  • [45] Big Data for Internet of Things: A Survey on IoT Frameworks and Platforms
    Atmani, Amine
    Kandrouch, Ibtissame
    Hmina, Nabil
    Chaoui, Habiba
    ADVANCED INTELLIGENT SYSTEMS FOR SUSTAINABLE DEVELOPMENT, AI2SD'2019, VOL 6: ADVANCED INTELLIGENT SYSTEMS FOR NETWORKS AND SYSTEMS, 2020, 92 : 59 - 67
  • [46] Real-time stream processing for Big Data
    Wingerath, Wolfram
    Gessert, Felix
    Friedrich, Steffen
    Ritter, Norbert
    IT-INFORMATION TECHNOLOGY, 2016, 58 (04): : 186 - 194
  • [47] Architectural Design Of Data Stream-Based Big Data Real-Time Analysis System
    Liu, Qiang
    Lv, Junmin
    Yuan, Xun
    Luo, Renyi
    Lv, Dekui
    PROCEEDINGS OF THE 2017 2ND JOINT INTERNATIONAL INFORMATION TECHNOLOGY, MECHANICAL AND ELECTRONIC ENGINEERING CONFERENCE (JIMEC 2017), 2017, 62 : 153 - 156
  • [48] Research on Real-time Processing and Stream Analysis of Unstructured Data Based on Big Data Platforms
    Liang, Huichao
    Wang, Di
    Liu, Yuan
    Mei, Lin
    Zhou, Mengxue
    Zhao, Haibin
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON MACHINE INTELLIGENCE AND DIGITAL APPLICATIONS, MIDA2024, 2024, : 96 - 101
  • [49] Kennard-Stone Balance Algorithm for Time-series Big Data Stream Mining
    Li, Tengyue
    Fong, Simon
    Wu, Yaoyang
    Tallon-Ballesteros, Antonio J.
    20TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2020), 2020, : 851 - 858
  • [50] Compressing Sampling for Time Series Big Data
    Miao Bei-bei
    Jin Xue-bo
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4957 - 4961