A Demonstration of ST-Hadoop: A MapReduce Framework for Big Spatio-temporal Data

被引:16
|
作者
Alarabi, Louai [1 ]
Mokbel, Mohamed F. [1 ]
机构
[1] Univ Minnesota, Dept Comp Sci & Engn, Minneapolis, MN 55455 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2017年 / 10卷 / 12期
关键词
D O I
10.14778/3137765.3137819
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This demo presents ST-Hadoop; the first full-fledged open-source MapReduce framework with a native support for spatio-temporal data. ST-Hadoop injects spatio-temporal awareness in the Hadoop base code, which results in achieving order(s) of magnitude better performance than Hadoop and SpatialHadoop when dealing with spatio-temporal data and queries. The key idea behind ST-Hadoop is its ability in indexing spatio-temporal data within Hadoop Distributed File System (HDFS). A real system prototype of ST-Hadoop, running on a local cluster of 24 machines, is demonstrated with two big-spatio-temporal datasets of Twitter and NYC Taxi data, each of around one billion records.
引用
下载
收藏
页码:1961 / 1964
页数:4
相关论文
共 50 条
  • [1] ST-Hadoop: a MapReduce framework for spatio-temporal data
    Alarabi, Louai
    Mokbel, Mohamed F.
    Musleh, Mashaal
    GEOINFORMATICA, 2018, 22 (04) : 785 - 813
  • [2] ST-Hadoop: A MapReduce Framework for Spatio-Temporal Data
    Alarabi, Louai
    Mokbel, Mohamed F.
    Musleh, Mashaal
    ADVANCES IN SPATIAL AND TEMPORAL DATABASES, SSTD 2017, 2017, 10411 : 84 - 104
  • [3] ST-Hadoop: a MapReduce framework for spatio-temporal data
    Louai Alarabi
    Mohamed F. Mokbel
    Mashaal Musleh
    GeoInformatica, 2018, 22 : 785 - 813
  • [4] A Spatio-temporal Multimedia Big Data Framework for a Large Crowd
    Sadiq, Bilal
    Rehman, Faizan Ur
    Ahmad, Akhlaq
    Rahman, Md. Abdur
    Ghani, Sohaib
    Murad, Abdullah
    Basalamah, Saleh
    Lbath, Ahmad
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 2742 - 2751
  • [5] Hadoop-based spatio-temporal analysis of urban public transportation big data
    Ni, Yan
    Huang, Yijie
    Li, Aidi
    Zhang, Jianqin
    Ding, Ying
    Zhao, Ming
    INTERNATIONAL CONFERENCE ON INTELLIGENT TRAFFIC SYSTEMS AND SMART CITY (ITSSC 2021), 2022, 12165
  • [6] An Approach to Enhance the Performance of Hadoop MapReduce Framework for Big Data
    Chandra, Subhash
    Motwani, Deepak
    2016 INTERNATIONAL CONFERENCE ON MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING (ICMETE), 2016, : 178 - 182
  • [7] Expanding ParaSQL for spatio-temporal (big) data
    Sugam Sharma
    Shashi Gadia
    The Journal of Supercomputing, 2019, 75 : 587 - 606
  • [8] Expanding ParaSQL for spatio-temporal (big) data
    Sharma, Sugam
    Gadia, Shashi
    JOURNAL OF SUPERCOMPUTING, 2019, 75 (02): : 587 - 606
  • [9] Cartography in the Age of Spatio-temporal Big Data
    Wang J.
    2017, SinoMaps Press (46): : 1226 - 1237
  • [10] STIFF: A forecasting framework for spatio-temporal data
    Li, ZG
    Dunham, MH
    Xia, YQ
    MINING MULTIMEDIA AND COMPLEX DATA, 2003, 2797 : 183 - 198