Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

被引:46
|
作者
Wu, Zebin [1 ]
Sun, Jin [1 ]
Zhang, Yi [1 ]
Wei, Zhihui [1 ]
Chanussot, Jocelyn [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Univ Grenoble Alpes, INRIA, Grenoble INP, CNRS,LJK, F-38000 Grenoble, France
基金
中国国家自然科学基金;
关键词
Remote sensing; Big Data; Cloud computing; Parallel processing; Distributed databases; Sensors; Processor scheduling; Big data; cloud computing; parallel and distributed processing; remote sensing; task scheduling; REAL-TIME IMPLEMENTATION; HYPERSPECTRAL UNMIXING CHAIN; COMPONENT ANALYSIS ALGORITHM; SENSING IMAGES; GPU IMPLEMENTATION; HIGH-PERFORMANCE; ENDMEMBER EXTRACTION; IMMUNE ALGORITHM; EFFICIENT; CLASSIFICATION;
D O I
10.1109/JPROC.2021.3087029
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article gives a survey of state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations on diverse popular high-performance computing platforms. The pros/cons of these approaches are discussed in terms of capability, scalability, reliability, and ease of use. Among existing distributed computing platforms, cloud computing is currently the most promising solution to efficient and scalable processing of remotely sensed big data due to its advanced capabilities for high-performance and service-oriented computing. We further provide an in-depth analysis of state-of-the-art cloud implementations that seek for exploiting the parallelism of distributed processing of remotely sensed big data. In particular, we study a series of scheduling algorithms (GSs) aimed at distributing the computation load across multiple cloud computing resources in an optimized manner. We conduct a thorough review of different GSs and reveal the significance of employing scheduling strategies to fully exploit parallelism during the remotely sensed big data processing flow. We present a case study on large-scale remote sensing datasets to evaluate the parallel and distributed approaches and algorithms. Evaluation results demonstrate the advanced capabilities of cloud computing in processing remotely sensed big data and the improvements in computational efficiency obtained by employing scheduling strategies.
引用
收藏
页码:1282 / 1305
页数:24
相关论文
共 50 条
  • [1] Distributed Computing for Remotely Sensed Data Processing
    Benediktsson, Jon Atli
    Wu, Zebin
    [J]. PROCEEDINGS OF THE IEEE, 2021, 109 (08) : 1278 - 1281
  • [2] Recent Developments and Future Directions in Parallel Processing of Remotely Sensed Hyperspectral Images
    Plaza, Antonio J.
    [J]. 2009 PROCEEDINGS OF 6TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2009), 2009, : 632 - 637
  • [3] An Efficient and Scalable Framework for Processing Remotely Sensed Big Data in Cloud Computing Environments
    Sun, Jin
    Zhang, Yi
    Wu, Zebin
    Zhu, Yaoqin
    Yin, Xianliang
    Ding, Zhongzheng
    Wei, Zhihui
    Plaza, Javier
    Plaza, Antonio
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (07): : 4294 - 4308
  • [4] Distributed computing model for processing remotely sensed images based on grid computing
    Shen, Zhanfeng
    Luo, Jiancheng
    Huang, Guangyu
    Ming, Dongping
    Ma, Weifeng
    Sheng, Hao
    [J]. INFORMATION SCIENCES, 2007, 177 (02) : 504 - 518
  • [5] ADVANCED PROCESSING OF REMOTELY SENSED BIG DATA FOR CULTURAL HERITAGE CONSERVATION
    Shimoni, M.
    Croonenborghs, T.
    Declercq, P. -Y
    Drougkas, A.
    Verstrynge, E.
    Hocquet, F-P.
    Hayen, R.
    Van Balen, K.
    [J]. 2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 5812 - 5815
  • [6] Parallel and distributed computing for Big Data applications
    Senger, Hermes
    Geyer, Claudio
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2016, 28 (08): : 2412 - 2415
  • [7] DIGITAL PROCESSING OF REMOTELY SENSED DATA
    KULKARNI, AD
    [J]. ADVANCES IN ELECTRONICS AND ELECTRON PHYSICS, 1986, 66 : 309 - 368
  • [8] An Efficient Parallel Computing Method for the Processing of Large Sensed Data
    Li, Dandan
    Ji, Xiaohui
    Wang, Qun
    [J]. AUTOMATIKA, 2013, 54 (04) : 471 - 482
  • [9] Parallel processing of remotely sensed data: Application to the ATSR-2 instrument
    Simpson, J.
    McIntire, T.
    Berg, J.
    Tsou, Y.
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2007, 49 (03) : 317 - 320