Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

被引:46
|
作者
Wu, Zebin [1 ]
Sun, Jin [1 ]
Zhang, Yi [1 ]
Wei, Zhihui [1 ]
Chanussot, Jocelyn [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Univ Grenoble Alpes, INRIA, Grenoble INP, CNRS,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金;
关键词
Remote sensing; Big Data; Cloud computing; Parallel processing; Distributed databases; Sensors; Processor scheduling; Big data; cloud computing; parallel and distributed processing; remote sensing; task scheduling; REAL-TIME IMPLEMENTATION; HYPERSPECTRAL UNMIXING CHAIN; COMPONENT ANALYSIS ALGORITHM; SENSING IMAGES; GPU IMPLEMENTATION; HIGH-PERFORMANCE; ENDMEMBER EXTRACTION; IMMUNE ALGORITHM; EFFICIENT; CLASSIFICATION;
D O I
10.1109/JPROC.2021.3087029
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article gives a survey of state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations on diverse popular high-performance computing platforms. The pros/cons of these approaches are discussed in terms of capability, scalability, reliability, and ease of use. Among existing distributed computing platforms, cloud computing is currently the most promising solution to efficient and scalable processing of remotely sensed big data due to its advanced capabilities for high-performance and service-oriented computing. We further provide an in-depth analysis of state-of-the-art cloud implementations that seek for exploiting the parallelism of distributed processing of remotely sensed big data. In particular, we study a series of scheduling algorithms (GSs) aimed at distributing the computation load across multiple cloud computing resources in an optimized manner. We conduct a thorough review of different GSs and reveal the significance of employing scheduling strategies to fully exploit parallelism during the remotely sensed big data processing flow. We present a case study on large-scale remote sensing datasets to evaluate the parallel and distributed approaches and algorithms. Evaluation results demonstrate the advanced capabilities of cloud computing in processing remotely sensed big data and the improvements in computational efficiency obtained by employing scheduling strategies.
引用
收藏
页码:1282 / 1305
页数:24
相关论文
共 50 条
  • [21] Parallel and Distributed Powerset Generation Using Big Data Processing
    Essa, Youssef M.
    El-Mahalawy, Ahmed
    Attiya, Gamal
    El-Sayed, Ayman
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2019, 33 (13) : 1133 - 1156
  • [22] Parallel Processing Architecture of Remotely Sensed Image Processing System Based on Cluster
    Liu, Hangye
    Fan, Yonghong
    Deng, Xueqing
    Ji, Song
    [J]. PROCEEDINGS OF THE 2009 2ND INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOLS 1-9, 2009, : 2970 - 2973
  • [23] Remotely Sensed Big Data Era and Intelligent Information Extraction
    Zhang B.
    [J]. Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2018, 43 (12): : 1861 - 1871
  • [24] Big data mining with parallel computing: A comparison of distributed and MapReduce methodologies
    Tsai, Chih-Fong
    Lin, Wei-Chao
    Ke, Shih-Wen
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2016, 122 : 83 - 92
  • [25] Computing geostatistical image texture for remotely sensed data classification
    Chica-Olmo, M
    Abarca-Hernández, F
    [J]. COMPUTERS & GEOSCIENCES, 2000, 26 (04) : 373 - 383
  • [26] Exploring uncertainty in remotely sensed data with parallel coordinate plots
    Ge, Yong
    Li, Sanping
    Lakhan, V. Chris
    Lucieer, Arko
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2009, 11 (06): : 413 - 422
  • [27] Recent trends of research and development for large-scale data storing and parallel distributed processing in big data era
    Fujii, Hidekaki
    Haraguchi, Hiroshi
    Hijiya, Makoto
    Iwazume, Michiaki
    Iwase, Takahiro
    [J]. Computer Software, 2013, 30 (01) : 130 - 151
  • [28] MASSIVELY PARALLEL IMAGE RECOGNITION SYSTEMS FOR REMOTELY SENSED DATA
    TENORIO, MF
    KUHL, FP
    [J]. TECHNICAL PAPERS : 1989 ASPRS/ACSM ANNUAL CONVENTION, VOL 5: SURVEYING & CARTOGRAPHY, 1989, : 48 - 57
  • [29] Research on distributed geocomputation environment adapting to remotely sensed image processing
    Ma Weifeng
    Li Jun
    Xu Zhiyi
    Shen Zhanfeng
    [J]. Advanced Computer Technology, New Education, Proceedings, 2007, : 666 - 670
  • [30] High Productivity Processing - Engaging in Big Data around Distributed Computing
    Riedel, Morris
    Memon, M.
    Memon, A.
    Fiameni, G.
    Cacciari, C.
    Lippert, Thomas
    [J]. 2013 36TH INTERNATIONAL CONVENTION ON INFORMATION AND COMMUNICATION TECHNOLOGY, ELECTRONICS AND MICROELECTRONICS (MIPRO), 2013, : 145 - 150