Processing Big Trajectory and Twitter Data Streams using Apache STORM

被引:0
|
作者
Stojanovic, Dragan [1 ]
Stojanovic, Natalija [1 ]
Turanjanin, Jovan [1 ]
机构
[1] Univ Nis, Fac Elect Engn, Aleksandra Medvedeva 14, Nish 18000, Serbia
关键词
big data; spatio-temporal data streams; trajectory data; geo-spatial processing; high performance computing;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this paper, we present research work related to processing and analysis of big trajectory and Twitter data streams using Apache Storm framework. We present the TrafficStorm application implemented as Storm topology, and describe its implementation on a cluster of commodity computers. TrafficStorm performs processing of big trajectory data streams related to users moving over a street network, as well as tweets issued by users in the area of interest. The experimental evaluation and results in detecting online traffic situation and crowded street segments in a real time, as well as possible explanation of such situation from correlated Twitter messages, demonstrate the feasibility of our approach.
引用
收藏
页码:301 / 304
页数:4
相关论文
共 50 条
  • [31] STREAM TEXT DATA ANALYSIS ON TWITTER USING APACHE SPARK STREAMING
    Hakdagli, Ozlem
    Ozcan, Caner
    Ogul, Iskender Ulgen
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [32] A Proposal of a Big Web Data Application and Archive for the Distributed Data Processing with Apache Hadoop
    Lnenicka, Martin
    Hovad, Jan
    Komarkova, Jitka
    COMPUTATIONAL COLLECTIVE INTELLIGENCE (ICCCI 2015), PT II, 2015, 9330 : 285 - 294
  • [33] Big Data Real-time Processing Based on Storm
    Yang, Wenjie
    Liu, Xingang
    Zhang, Lan
    Yang, Laurence T.
    2013 12TH IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2013), 2013, : 1784 - 1787
  • [34] Software Systems for Processing and Analysis of Big Data and Event Streams
    Stojnev, Aleksandra I.
    Stojanovic, Dragan H.
    2017 13TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES, SYSTEMS AND SERVICES IN TELECOMMUNICATIONS (TELSIKS), 2017, : 128 - 131
  • [35] IBM Streams Processing Language: Analyzing Big Data in motion
    Hirzel, M.
    Andrade, H.
    Gedik, B.
    Jacques-Silva, G.
    Khandekar, R.
    Kumar, V.
    Mendell, M.
    Nasgaard, H.
    Schneider, S.
    Soule, R.
    Wu, K. -L.
    IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2013, 57 (3-4)
  • [36] Investigation of Reconfigurable FPGA Design for Processing Big Data Streams
    Algemili, Usamah
    2016 IEEE 2ND INTERNATIONAL CONFERENCE ON BIG DATA SECURITY ON CLOUD (BIGDATASECURITY), IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING (HPSC), AND IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA AND SECURITY (IDS), 2016, : 226 - 233
  • [37] STREAMSCOPE: Continuous Reliable Distributed Processing of Big Data Streams
    Lin, Wei
    Fan, Haochuan
    Qian, Zhengping
    Xu, Junwei
    Yang, Sen
    Zhou, Jingren
    Zhou, Lidong
    13TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION (NSDI '16), 2016, : 439 - 453
  • [38] Apache Pig Programming for Processing the Big Medical Data of Patients with Distributed Environment
    Aravinth, S.S.
    Kumar, M. Ramesh
    Ranganathan, R.
    Parameswari, M.
    Sasikala, M.
    International Conference on Edge Computing and Applications, ICECAA 2022 - Proceedings, 2022, : 200 - 204
  • [39] Performance Comparison of Big Data Processing Utilizing SciDB and Apache Accumulo Databases
    Abu Mhana, Mohammad
    Khalifeh, Ala'
    Alouneh, Sahel
    2022 SEVENTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING, FMEC, 2022, : 17 - 21
  • [40] RDMA-Based Apache Storm for High-Performance Stream Data Processing
    Ziyu Zhang
    Zitan Liu
    Qingcai Jiang
    Junshi Chen
    Hong An
    International Journal of Parallel Programming, 2021, 49 : 671 - 684