Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

被引:46
|
作者
Wu, Zebin [1 ]
Sun, Jin [1 ]
Zhang, Yi [1 ]
Wei, Zhihui [1 ]
Chanussot, Jocelyn [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Univ Grenoble Alpes, INRIA, Grenoble INP, CNRS,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金;
关键词
Remote sensing; Big Data; Cloud computing; Parallel processing; Distributed databases; Sensors; Processor scheduling; Big data; cloud computing; parallel and distributed processing; remote sensing; task scheduling; REAL-TIME IMPLEMENTATION; HYPERSPECTRAL UNMIXING CHAIN; COMPONENT ANALYSIS ALGORITHM; SENSING IMAGES; GPU IMPLEMENTATION; HIGH-PERFORMANCE; ENDMEMBER EXTRACTION; IMMUNE ALGORITHM; EFFICIENT; CLASSIFICATION;
D O I
10.1109/JPROC.2021.3087029
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article gives a survey of state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations on diverse popular high-performance computing platforms. The pros/cons of these approaches are discussed in terms of capability, scalability, reliability, and ease of use. Among existing distributed computing platforms, cloud computing is currently the most promising solution to efficient and scalable processing of remotely sensed big data due to its advanced capabilities for high-performance and service-oriented computing. We further provide an in-depth analysis of state-of-the-art cloud implementations that seek for exploiting the parallelism of distributed processing of remotely sensed big data. In particular, we study a series of scheduling algorithms (GSs) aimed at distributing the computation load across multiple cloud computing resources in an optimized manner. We conduct a thorough review of different GSs and reveal the significance of employing scheduling strategies to fully exploit parallelism during the remotely sensed big data processing flow. We present a case study on large-scale remote sensing datasets to evaluate the parallel and distributed approaches and algorithms. Evaluation results demonstrate the advanced capabilities of cloud computing in processing remotely sensed big data and the improvements in computational efficiency obtained by employing scheduling strategies.
引用
收藏
页码:1282 / 1305
页数:24
相关论文
共 50 条
  • [41] Remotely sensed image distributed processing system design with Web Services technology
    Shen, ZF
    Ming, DP
    Li, JL
    [J]. IGARSS 2005: IEEE International Geoscience and Remote Sensing Symposium, Vols 1-8, Proceedings, 2005, : 4244 - 4247
  • [42] Distributed Computing and Inference for Big Data
    Zhou, Ling
    Gong, Ziyang
    Xiang, Pengcheng
    [J]. ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION, 2024, 11 : 533 - 551
  • [43] In-Memory Parallel Processing of Massive Remotely Sensed Data Using an Apache Spark on Hadoop YARN Model
    Huang, Wei
    Meng, Lingkui
    Zhang, Dongying
    Zhang, Wen
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (01) : 3 - 19
  • [44] Integrated data processing of remotely sensed and vector data for building change detection
    Sofina, N.
    Ehlers, M.
    Michel, U.
    [J]. EARTH RESOURCES AND ENVIRONMENTAL REMOTE SENSING/GIS APPLICATIONS III, 2012, 8538
  • [45] A New Tool for Intelligent Parallel Processing of Radar/SAR Remotely Sensed Imagery
    Castillo Atoche, A.
    Carrasco Alvarez, R.
    Ortegon Aguilar, J.
    Vazquez Castillo, J.
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2013, 2013
  • [46] Brain big data processing with massively parallel computing technology: challenges and opportunities
    Chen, Dan
    Hu, Yangyang
    Cai, Chang
    Zeng, Ke
    Li, Xiaoli
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 2017, 47 (03): : 405 - 420
  • [47] Recent advances in parallel computing and distributed network
    Li, Zhiyang
    Li, Keqiu
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (16): : 4137 - 4139
  • [48] Dynamic Distributed and Parallel Machine Learning algorithms for big data mining processing
    Djafri, Laouni
    [J]. DATA TECHNOLOGIES AND APPLICATIONS, 2022, 56 (04) : 558 - 601
  • [49] A grid-based programming environment for remotely sensed data processing
    Wu, CL
    Xue, Y
    Wang, JQ
    Luo, Y
    [J]. ADVANCED WEB AND NETWORK TECHNOLOGIES, AND APPLICATIONS, PROCEEDINGS, 2006, 3842 : 560 - 564
  • [50] Parallel and distributed processing for high resolution agricultural tomography based on big data
    Alves, Gabriel M.
    Cruvinel, Paulo E.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 10115 - 10146