Processing Big Trajectory and Twitter Data Streams using Apache STORM

被引：0
|
作者：
Stojanovic, Dragan [1 ]
Stojanovic, Natalija [1 ]
Turanjanin, Jovan [1 ]
机构：
[1] Univ Nis, Fac Elect Engn, Aleksandra Medvedeva 14, Nish 18000, Serbia
来源：
2015 12TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS IN MODERN SATELLITE, CABLE AND BROADCASTING SERVICES (TELSIKS) | 2015年
关键词：
big data; spatio-temporal data streams; trajectory data; geo-spatial processing; high performance computing;
D O I：
暂无
中图分类号：
TN [电子技术、通信技术];
学科分类号：
0809 ;
摘要：
In this paper, we present research work related to processing and analysis of big trajectory and Twitter data streams using Apache Storm framework. We present the TrafficStorm application implemented as Storm topology, and describe its implementation on a cluster of commodity computers. TrafficStorm performs processing of big trajectory data streams related to users moving over a street network, as well as tweets issued by users in the area of interest. The experimental evaluation and results in detecting online traffic situation and crowded street segments in a real time, as well as possible explanation of such situation from correlated Twitter messages, demonstrate the feasibility of our approach.
引用
收藏
页码：301 / 304
页数：4
相关论文
共 50 条
  • [1] Social Media Data Processing Infrastructure by Using Apache Spark Big Data Platform: Twitter Data Analysis
    Podhoranyi, Michal
    Vojacek, Lukas
    2019 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTERNET OF THINGS (CCIOT 2019), 2019, : 1 - 6
  • [2] Big Data Emerging Technologies: A CaseStudy with Analyzing Twitter Data using Apache Hive
    Bhardwaj, Aditya
    Vanraj
    Kumar, Ankit
    Narayan, Yogendra
    Kumar, Pawan
    2015 2ND INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN ENGINEERING & COMPUTATIONAL SCIENCES (RAECS), 2015,
  • [3] Use of Apache Flume in the Big Data Environment for Processing and Evaluation of the Data Quality of the Twitter Social Network
    Tenesaca-Luna, Gladys-Alicia
    Imba, Diego
    Mora-Arciniegas, Maria-Belen
    Segarra-Faggioni, Veronica
    Leonardo Ramirez-Coronel, Ramiro
    INFORMATION AND COMMUNICATION TECHNOLOGIES OF ECUADOR (TIC.EC), 2019, 884 : 314 - 326
  • [4] Big Data Network Flow Processing Using Apache Spark
    Jerabek, Kamil
    Rysavy, Ondrej
    PROCEEDINGS OF THE 6TH CONFERENCE ON THE ENGINEERING OF COMPUTER BASED SYSTEMS (ECBS 2019), 2020,
  • [5] Processing of Big Educational Data in the Cloud Using Apache Hadoop
    Machova, Renata
    Komarkova, Jitka
    Lnenicka, Martin
    INTERNATIONAL CONFERENCE ON INFORMATION SOCIETY (I-SOCIETY 2016), 2016, : 46 - 49
  • [6] Big Spatial Data Processing With Apache Spark
    Boyi Shangguan
    Peng Yue
    Wu, Zhaoyan
    Jiang, Liangcun
    2017 6TH INTERNATIONAL CONFERENCE ON AGRO-GEOINFORMATICS, 2017, : 239 - 242
  • [7] Apache Spark: A Big Data Processing Engine
    Shaikh, Eman
    Mohiuddin, Iman
    Alufaisan, Yasmeen
    Nahvi, Irum
    2019 2ND IEEE MIDDLE EAST AND NORTH AFRICA COMMUNICATIONS CONFERENCE (IEEEMENACOMM'19), 2019, : 220 - 225
  • [8] A Mining Algorithm of Frequent Items in Data Streams Based on Apache Storm
    Hu, Weihua
    Guo, Ziang
    Chen, Mingzhong
    PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON MECHATRONICS, MATERIALS, CHEMISTRY AND COMPUTER ENGINEERING 2015 (ICMMCCE 2015), 2015, 39 : 2926 - 2930
  • [9] Twitter Streams Fuel Big Data Approaches to Health Forecasting
    Kuehn, Bridget M.
    JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2015, 314 (19): : 2010 - 2012
  • [10] Apache Spark: A Unified Engine for Big Data Processing
    Zaharia, Matei
    Xin, Reynold S.
    Wendell, Patrick
    Das, Tathagata
    Armbrust, Michael
    Dave, Ankur
    Meng, Xiangrui
    Rosen, Josh
    Venkataraman, Shivaram
    Franklin, Michael J.
    Ghodsi, Ali
    Gonzalez, Joseph
    Shenker, Scott
    Stoica, Ion
    COMMUNICATIONS OF THE ACM, 2016, 59 (11) : 56 - 65
12345