Analysis of Geospatial Data Loading

被引:0
|
作者
Wachs, Aske [1 ]
Zacharatou, Eleni Tzirita [1 ]
机构
[1] IT Univ Copenhagen, Copenhagen, Denmark
关键词
spatial libraries; benchmarking; micro-architectural analysis;
D O I
10.1145/3662165.3662761
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The rate at which applications gather geospatial data today has turned data loading into a critical component of data analysis pipelines. However, users are confronted with multiple file formats for storing geospatial data and an array of systems for processing it. To shed light on how the choice of file format and system affects performance, this paper explores the performance of loading geospatial data stored in diverse file formats using different libraries. It aims to study the impact of different file formats, compare loading throughput across spatial libraries, and examine the micro-architectural behavior of geospatial data loading. Our findings show that GeoParquet files provide the highest loading throughput across all benchmarked libraries. Furthermore, we note that the more spatial features per byte a file format can store, the higher the data loading throughput. Our micro-architectural analysis reveals high instructions per cycle (IPC) during spatial data loading for most libraries and formats. Additionally, our experiments show that instruction misses dominate L1 cache misses, except for GeoParquet files, where data misses take over.
引用
收藏
页码:36 / 42
页数:7
相关论文
共 50 条
  • [1] Big Data Environment for Geospatial Data Analysis
    Praveen, P.
    Babu, Ch. Jayanth
    Rama, B.
    [J]. PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMMUNICATION AND ELECTRONICS SYSTEMS (ICCES), 2016, : 573 - 578
  • [2] GeoSpatial Data Analysis for DHS Programs
    Stephan, Eric
    Burke, John
    Carlson, Carrie
    Gillen, Dave
    Joslyn, Cliff
    Olsen, Bryan
    Critchlow, Terence
    [J]. 2009 IEEE CONFERENCE ON TECHNOLOGIES FOR HOMELAND SECURITY, 2009, : 545 - 552
  • [3] Geospatial Data Integration for Criminal Analysis
    Pietak, Kamil
    Dajda, Jacek
    Wysokinski, Michal
    Idzik, Michal
    Lesniak, Lukasz
    [J]. MAN-MACHINE INTERACTIONS 4, ICMMI 2015, 2016, 391 : 461 - 471
  • [4] Interoperability in planetary research for geospatial data analysis
    Hare, Trent M.
    Rossi, Angelo P.
    Frigeri, Alessandro
    Marmo, Chiara
    [J]. PLANETARY AND SPACE SCIENCE, 2018, 150 : 36 - 42
  • [5] Artificial intelligence and analysis of geospatial big data
    Carlucci, Renzo
    [J]. GEOMEDIA, 2018, 22 (06) : 5 - 5
  • [6] Geospatial study for wind analysis and design codes for wind loading: A review
    Hamzah, Nur Hamizah
    Usman, Fathoni
    Omar, Rohayu Che
    [J]. INTERNATIONAL JOURNAL OF ADVANCED AND APPLIED SCIENCES, 2018, 5 (01): : 94 - 100
  • [7] Geospatial analysis of wind velocity to determine wind loading on transmission tower
    Hamzah, Nur H.
    Usman, Fathoni
    [J]. WIND AND STRUCTURES, 2019, 28 (06) : 381 - 388
  • [8] HAZARD HOTSPOTS ANALYSIS FROM GEOSPATIAL DATABASE USING GEOSPATIAL DATA MINING TECHNOLOGY
    Hsu, Pai-Hui
    Su, Wen-Ray
    [J]. 2012 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2012, : 962 - 965
  • [9] Geospatial Big Data or Big Geospatial Data: A Bibliometric Review
    Ndu, Chidinma Godsgood
    Shoko, Moreblessings
    [J]. SOUTH AFRICAN JOURNAL OF GEOMATICS, 2024, 13 (01): : 158 - 171
  • [10] Efficient Geospatial Data Analysis Framework in Fog Environment
    Saber, Walaa
    Eisa, Rania
    Attia, Radwa
    [J]. IEEE ACCESS, 2022, 10 : 133591 - 133600