A Spark-based parallel framework for geospatial raster data processing

被引:0
|
作者
Gao, Fan [1 ]
Yue, Peng [1 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, 129 Luoyu Rd, Wuhan 430079, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Spark; RsImage model; RsBundleImage model; DOMAIN DECOMPOSITION; STRATEGIES;
D O I
暂无
中图分类号
S3 [农学(农艺学)];
学科分类号
0901 ;
摘要
With the rapid development of geospatial sensor technologies in recent years, the acquisition of higher resolution of spatial and temporal data is becoming common, resulting in an explosive increase in the volume of geospatial data. Meanwhile, the sophistication and complexity of geospatial algorithms is also increasing. The current geospatial applications often have limited capabilities in dealing with the trend. In this paper, we proposed a Spark-based parallel framework for geospatial raster data processing. The framework provides a parallel processing way for both a single high-resolution remote sensing image with large size using a RsImage model and multiple remote sensing images with small size using a RsBundleImage model. Taking the edge extraction from remote sensing images as an example, the paper demonstrates how the framework can improve the efficiency of the Canny edge detector by achieving the ratio of speedup up to 7.0 similar to 8.0.
引用
收藏
页码:53 / 56
页数:4
相关论文
共 50 条
  • [1] Efficient Spark-Based Framework for Big Geospatial Data Query Processing and Analysis
    Aljawarneh, Isam Mashhour
    Bellavista, Paolo
    Corradi, Antonio
    Montanari, Rebecca
    Foschini, Luca
    Zanotti, Andrea
    [J]. 2017 IEEE SYMPOSIUM ON COMPUTERS AND COMMUNICATIONS (ISCC), 2017, : 851 - 856
  • [2] Spark-based parallel processing whale optimization algorithm
    Alshayeji, Mohammad
    Behbehani, Bader
    Ahmad, Imtiaz
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (04):
  • [3] OSMX: Spark-based Geospatial Data Extractor from OpenStreetMap
    Singla, Samriddhi
    Zhang, Yaming
    Eldawy, Ahmed
    [J]. 30TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS, ACM SIGSPATIAL GIS 2022, 2022, : 145 - 148
  • [4] A Dynamic Spark-based Classification Framework for Imbalanced Big Data
    Nahla B. Abdel-Hamid
    Sally ElGhamrawy
    Ali El Desouky
    Hesham Arafat
    [J]. Journal of Grid Computing, 2018, 16 : 607 - 626
  • [5] A Dynamic Spark-based Classification Framework for Imbalanced Big Data
    Abdel-Hamid, Nahla B.
    ElGhamrawy, Sally
    El Desouky, Ali
    Arafat, Hesham
    [J]. JOURNAL OF GRID COMPUTING, 2018, 16 (04) : 607 - 626
  • [6] Spark-based deep classifier framework for imbalanced data classification
    Bhowate, Vikas Gajananrao
    Reddy, T. Hanumantha
    [J]. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2023, 11 (05): : 1661 - 1677
  • [7] Spark-Based Parallel Method for Prediction of Events
    B. S. A. S. Rajita
    Yash Ranjan
    Chandekar Tanmay Umesh
    Subhrakanta Panda
    [J]. Arabian Journal for Science and Engineering, 2020, 45 : 3437 - 3453
  • [8] A Spark-Based Big Data Platform for Massive Remote Sensing Data Processing
    Sun, Zhongyi
    Chen, Fengke
    Chi, Mingmin
    Zhu, Yangyong
    [J]. DATA SCIENCE, 2015, 9208 : 120 - 126
  • [9] Spark-Based Parallel Method for Prediction of Events
    Rajita, B. S. A. S.
    Ranjan, Yash
    Umesh, Chandekar Tanmay
    Panda, Subhrakanta
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2020, 45 (04) : 3437 - 3453
  • [10] A parallel framework on hybrid architectures for raster-based geospatial cellular automata models
    Gao, Huan
    Liang, Zhewei
    Guan, Qingfeng
    Liang, Xun
    Zeng, Wen
    [J]. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2024, 38 (07) : 1336 - 1359