Performance Evaluation of Spatial Data Management Systems Using GeoSpark

被引:3
|
作者
Shin, Hansub [1 ]
Lee, Kisung [2 ]
Kwon, Hyuk-Yoon [1 ]
机构
[1] Seoul Natl Univ Sci & Technol, Dept Ind & Syst Engn, Seoul, South Korea
[2] Louisiana State Univ, Div Comp Sci & Engn, Baton Rouge, LA 70803 USA
基金
新加坡国家研究基金会;
关键词
Large-scale spatial data; GeoSpark; Performance evaluation; Distributed environments; BIG DATA;
D O I
10.1109/BigComp48618.2020.00-75
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we evaluate the performance of spatial data management systems in distributed computing environments. Given that GeoSpark outperforms other spatial systems in many scenarios as reported in several studies, we choose spatial data management systems using GeoSpark for this evaluation. Even though GeoSpark supports various storage engines as its underlying data store, the effects of the storage engines for spatial data processing have not been well studied. To address this limitation, we evaluate the performance of GeoSpark using two underlying data stores: 1) HDFS and 2) MongoDB. We first design and build distributed experimental environments based on Amazon EC2 and EMR using up to 10 nodes. Through the extensive experiments on three synthetic and real data sets, we show that the overall performance of both HDFS- and MongoDB-based GeoSpark improves as we increase the number of nodes. We also show that HDFS-based GeoSpark generally outperforms MongoDB-based GeoSpark, especially for large-scale data sets. In addition, we demonstrate that the proper use of caching on HDFS-based GeoSpark can improve the overall query processing performance by up to three orders of magnitude.
引用
收藏
页码:197 / 200
页数:4
相关论文
共 50 条
  • [31] Managing method of spatial data in relational database management systems
    Zhu, Tie-Wen
    Zhong, Zhi-Nong
    Jing, Ning
    Ruan Jian Xue Bao/Journal of Software, 2002, 13 (01): : 8 - 14
  • [32] Spatial data acquisition, management and visualization in geographic information systems
    DobricǍ, Liliana
    Ionescu, Traian
    DobricǍ, Leonard
    Colesca, Sofia Elena
    UPB Scientific Bulletin, Series C: Electrical Engineering, 2010, 72 (03): : 93 - 108
  • [33] Spatial Query Processing on AIS Data Streams in Data Stream Management Systems
    Brandt, Tobias
    Grawunder, Marco
    BUSINESS INFORMATION SYSTEMS WORKSHOPS, BIS 2019, 2019, 373 : 461 - 472
  • [34] Management systems and spatial data analysis in transportation and highway engineering
    Goulias, DG
    MANAGEMENT INFORMATION SYSTEMS 2002: INCORPORATING GIS AND REMOTE SENSING, 2002, 4 : 321 - 327
  • [35] SPATIAL DATA ACQUISITION, MANAGEMENT AND VISUALIZATION IN GEOGRAPHIC INFORMATION SYSTEMS
    Dobrica, Liliana
    Ionescu, Traian
    Dobrica, Leonard
    Colesca, Sofia Elena
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2010, 72 (03): : 93 - 108
  • [36] Location-based spatial data management in navigation systems
    Bouju, A
    Stockus, A
    Bertrand, F
    Boursier, P
    IV'2002: IEEE INTELLIGENT VEHICLE SYMPOSIUM, PROCEEDINGS, 2002, : 172 - 177
  • [37] Performance Evaluation of JPCP with Changes of Pavement Mix Design Using Pavement Management Data
    Oh, Han Jin
    Park, Jun Young
    Kim, Hyung Bae
    Jung, Won Kyong
    Lee, Jung Hun
    ADVANCES IN CIVIL ENGINEERING, 2019, 2019
  • [38] Performance Evaluation on Data Management Approach for Multiple Clouds Using Secret Sharing Scheme
    Kanai, Atsushi
    Tanimoto, Shigeaki
    Sato, Hiroyuki
    2016 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2016,
  • [39] Efficiency Evaluation of Regional Environmental Management Systems in Russia Using Data Envelopment Analysis
    Ratner, Svetlana
    Lychev, Andrey
    Rozhnov, Aleksei
    Lobanov, Igor
    MATHEMATICS, 2021, 9 (18)
  • [40] Developing Network Slurry Seal Performance Models Using Pavement Management Systems Data
    Cheng, DingXin
    Smith, Roger E.
    Tan, Sui G.
    Jaquiz, Mario
    Chang, Carlos M.
    TRANSPORTATION RESEARCH RECORD, 2022, 2676 (09) : 389 - 396