Near real-time big-data processing for data driven applications

被引:7
|
作者
Kampars, Janis [1 ]
Grabis, Janis [1 ]
机构
[1] Riga Tech Univ, Inst Informat Technol, Riga, Latvia
关键词
stream processing; big data; cloud computing; data-driven systems;
D O I
10.1109/Innovate-Data.2017.11
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper addresses the context data integration and processing problem for design of data driven application by introducing ASAPCS (Auto-scaling and Adjustment Platform for Cloud-based Systems) platform. Conceptual model, technical architecture and data integration process are described. The ASAPCS platform supports model-driven configuration, separation of context acquisition and application, utilization of various context processing algorithms and scalability. It is based on technologies that have proven to work well with big data and each part of it is horizontally scalable. ASAPCs integrates data from heterogeneous sources and aggregates raw context data and uses it to perform real-time adjustments in the data-driven application. Its application is illustrated with example of providing data store resilience.
引用
收藏
页码:35 / 42
页数:8
相关论文
共 50 条
  • [1] Efficient Storage of Big-Data for Real-Time GPS Applications
    Akulakrishna, Pavan Kumar
    Lakshmi, J.
    Nandy, S. K.
    [J]. 2014 IEEE FOURTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING (BDCLOUD), 2014, : 1 - 8
  • [2] Parallel Job Processing Technique for Real-time Big-Data Processing Framework
    Son, Jae Gi
    Kang, Ji-Woo
    An, Jae-Hoon
    Ahn, Hyung-Joo
    Chun, Hyo-Jung
    Kim, Jung-Guk
    [J]. 2016 RESEARCH IN ADAPTIVE AND CONVERGENT SYSTEMS, 2016, : 226 - 229
  • [3] Real-time intelligent big data processing: technology, platform, and applications
    Tongya Zheng
    Gang Chen
    Xinyu Wang
    Chun Chen
    Xingen Wang
    Sihui Luo
    [J]. Science China Information Sciences, 2019, 62
  • [4] Real-time intelligent big data processing: technology, platform, and applications
    Zheng, Tongya
    Chen, Gang
    Wang, Xinyu
    Chen, Chun
    Wang, Xingen
    Luo, Sihui
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2019, 62 (08)
  • [5] Real-time intelligent big data processing:technology, platform, and applications
    Tongya ZHENG
    Gang CHEN
    Xinyu WANG
    Chun CHEN
    Xingen WANG
    Sihui LUO
    [J]. Science China(Information Sciences), 2019, 62 (08) : 102 - 113
  • [6] Real-time stream processing for Big Data
    Wingerath, Wolfram
    Gessert, Felix
    Friedrich, Steffen
    Ritter, Norbert
    [J]. IT-INFORMATION TECHNOLOGY, 2016, 58 (04): : 186 - 194
  • [7] Real-time processing of streaming big data
    Safaei, Ali A.
    [J]. REAL-TIME SYSTEMS, 2017, 53 (01) : 1 - 44
  • [8] Real-time processing of streaming big data
    Ali A. Safaei
    [J]. Real-Time Systems, 2017, 53 : 1 - 44
  • [9] Near Real-Time Big Data Stream Processing Platform Using Cassandra
    Pal, Gautam
    Li, Gangmin
    Atkinson, Katie
    [J]. 2018 4TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2018,
  • [10] Logical big data integration and near real-time data analytics
    Silva, Bruno
    Moreira, Jose
    Costa, Rogerio Luis de C.
    [J]. DATA & KNOWLEDGE ENGINEERING, 2023, 146