Stream Processing with BigData: SSS-MapReduce

被引：0
|
作者：
Nakada, Hidemoto [1 ]
Ogawa, Hirotaka [1 ]
Kudoh, Tomohiro [1 ]
机构：
[1] Natl Inst Adv Ind Sci & Technol, 1-1-1 Umezono, Tsukuba, Ibaraki 3058568, Japan
来源：
2012 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM) | 2012年
关键词：
D O I：
暂无
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
We propose a MapReduce based stream processing system, called SSS, which is capable of processing stream along with large scale static data. Unlike the existing stream processing systems that can work only on the relatively small on-memory data-set, SSS can process incoming streamed data consulting the stored data. SSS processes streamed data with continuous Mappers and Reducers, which are periodically invoked by the system. It also supports merge operation on two sets of data, which enables stream data processing with large static data. This poster shows overview of SSS stream processing and preliminary evaluation results.
引用
收藏
页数：4
相关论文
共 50 条
  • [1] Research of a MapReduce Communication Data Stream Processing Model
    Yang, Wenchuan
    Jia, Bei
    [J]. PROCEEDINGS OF THE 1ST INTERNATIONAL WORKSHOP ON CLOUD COMPUTING AND INFORMATION SECURITY (CCIS 2013), 2013, 52 : 28 - 31
  • [2] AJIRA: a Lightweight Distributed Middleware for MapReduce and Stream Processing
    Urbani, Jacopo
    Margara, Alessandro
    Jacobs, Ceriel
    Voulgaris, Spyros
    Bal, Henri
    [J]. 2014 IEEE 34TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2014), 2014, : 545 - 554
  • [3] A BigData MapReduce Hadoop Distribution Architecture for Processing Input Splits to solve the Small Data Problem
    Manjunath, R.
    Tejus
    Channabasava, R. K.
    Balaji, S.
    [J]. PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL COMPUTING AND COMMUNICATION TECHNOLOGY (ICATCCT), 2016, : 480 - 487
  • [4] Performance Enhancement of Hadoop MapReduce Framework for Analyzing BigData
    Prabhu, Swathi
    Rodrigues, Anisha P.
    Prasad, Guru M. S.
    Nagesh, H. R.
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES, 2015,
  • [5] Optimizing Cloud MapReduce for Processing Stream Data using Pipelining
    Karve, Rutvik
    Dahiphale, Devendra
    Chhajer, Amit
    [J]. UKSIM FIFTH EUROPEAN MODELLING SYMPOSIUM ON COMPUTER MODELLING AND SIMULATION (EMS 2011), 2011, : 344 - 349
  • [6] AN APPROACH FOR STITCHING SATELLITE IMAGES IN A BIGDATA MAPREDUCE FRAMEWORK
    Sari, H.
    Eken, S.
    Sayar, A.
    [J]. 4TH INTERNATIONAL GEOADVANCES WORKSHOP - GEOADVANCES 2017: ISPRS WORKSHOP ON MULTI-DIMENSIONAL & MULTI-SCALE SPATIAL DATA MODELING, 2017, 4-4 (W4): : 351 - 355
  • [7] A Survey on Recommendation System for Bigdata using MapReduce Technology
    Dhamecha, Maulik
    Dobaria, Krupa
    Patalia, Tejas
    [J]. PROCEEDINGS OF THE 2019 3RD INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC 2019), 2019, : 54 - 58
  • [8] Prefetched wald adaptive boost classification based Czekanowski similarity MapReduce for user query processing with bigdata
    S. Tamil Selvan
    P. Balamurugan
    M. Vijayakumar
    [J]. Distributed and Parallel Databases, 2021, 39 : 855 - 872
  • [9] Prefetched wald adaptive boost classification based Czekanowski similarity MapReduce for user query processing with bigdata
    Selvan, S. Tamil
    Balamurugan, P.
    Vijayakumar, M.
    [J]. DISTRIBUTED AND PARALLEL DATABASES, 2021, 39 (04) : 855 - 872
  • [10] A BigData Approach for Classification and Prediction of Student Result Using MapReduce
    Mohan, Midhun M. G.
    Augustin, Siju K.
    Roshni, Kumari V. S.
    [J]. PROCEEDINGS OF THE 2015 IEEE RECENT ADVANCES IN INTELLIGENT COMPUTATIONAL SYSTEMS (RAICS), 2015, : 145 - 150
12345