Cloud-based storage and computing for remote sensing big data: a technical review

被引:14
|
作者
Xu, Chen [1 ,2 ,3 ]
Du, Xiaoping [1 ,2 ]
Fan, Xiangtao [1 ,2 ]
Giuliani, Gregory [4 ]
Hu, Zhongyang [5 ]
Wang, Wei [6 ]
Liu, Jie [6 ]
Wang, Teng [7 ]
Yan, Zhenzhen [1 ,2 ]
Zhu, Junjie [1 ,2 ]
Jiang, Tianyang [8 ]
Guo, Huadong [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing, Peoples R China
[4] Univ Geneva, Inst Environm Sci GRID Geneva, Geneva, Switzerland
[5] Univ Utrecht, Inst Marine & Atmospher Res Utrecht IMAU, Utrecht, Netherlands
[6] Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China
[7] Peoples Republ China Telecom Co Ltd, Tianyi Cloud, Guangzhou, Peoples R China
[8] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; big data; cloud computing; data cube; analysis ready data; parallel computing; data model; EARTH DATA; MODEL; ANALYTICS; FRAMEWORK; OPPORTUNITIES; EFFICIENT; LANDSAT; SCIENCE; SYSTEMS;
D O I
10.1080/17538947.2022.2115567
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The rapid growth of remote sensing big data (RSBD) has attracted considerable attention from both academia and industry. Despite the progress of computer technologies, conventional computing implementations have become technically inefficient for processing RSBD. Cloud computing is effective in activating and mining large-scale heterogeneous data and has been widely applied to RSBD over the past years. This study performs a technical review of cloud-based RSBD storage and computing from an interdisciplinary viewpoint of remote sensing and computer science. First, we elaborate on four critical technical challenges resulting from the scale expansion of RSBD applications, i.e. raster storage, metadata management, data homogeneity, and computing paradigms. Second, we introduce state-of-the-art cloud-based data management technologies for RSBD storage. The unit for manipulating remote sensing data has evolved due to the scale expansion and use of novel technologies, which we name the RSBD data model. Four data models are suggested, i.e. scenes, ARD, data cubes, and composite layers. Third, we summarize recent research on the application of various cloud-based parallel computing technologies to RSBD computing implementations. Finally, we categorize the architectures of mainstream RSBD platforms. This research provides a comprehensive review of the fundamental issues of RSBD for computing experts and remote sensing researchers.
引用
收藏
页码:1417 / 1445
页数:29
相关论文
共 50 条
  • [1] A cloud-based remote sensing data production system
    Yan, Jining
    Ma, Yan
    Wang, Lizhe
    Choo, Kim-Kwang Raymond
    Jie, Wei
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 1154 - 1166
  • [2] Cloud Computing in Remote Sensing : High Performance Remote Sensing Data Processing in a Big data Environment
    Sabri, Y.
    Aouad, S.
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2021, 16 (06)
  • [3] Cloud Computing in Remote Sensing: Big Data Remote Sensing Knowledge Discovery and Information Analysis
    Sabri, Yassine
    Bahja, Fadoua
    Siham, Aouad
    Maizate, Aberrahim
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (05) : 888 - 895
  • [4] Cloud-Based Remote Sensing for Wetland Monitoring-A Review
    Abdelmajeed, Abdallah Yussuf Ali
    Albert-Saiz, Mar
    Rastogi, Anshu
    Juszczak, Radoslaw
    [J]. REMOTE SENSING, 2023, 15 (06)
  • [5] Big data classification of remote sensing image based on cloud computing and convolutional neural network
    Wu, Xiaobo
    [J]. SOFT COMPUTING, 2022,
  • [6] Google Earth Engine Cloud Computing Platform for Remote Sensing Big Data Applications: A Comprehensive Review
    Amani, Meisam
    Ghorbanian, Arsalan
    Ahmadi, Seyed Ali
    Kakooei, Mohammad
    Moghimi, Armin
    Mirmazloumi, S. Mohammad
    Moghaddam, Sayyed Hamed Alizadeh
    Mahdavi, Sahel
    Ghahremanloo, Masoud
    Parsian, Saeid
    Wu, Qiusheng
    Brisco, Brian
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 (13) : 5326 - 5350
  • [7] Review of Big Data Storage based on DNA Computing
    Hakami, Hanadi Ahmed
    Chaczko, Zenon
    Kale, Anup
    [J]. 2015 ASIA-PACIFIC CONFERENCE ON COMPUTER-AIDED SYSTEM ENGINEERING - APCASE 2015, 2015, : 113 - 117
  • [8] pipsCloud: High performance cloud computing for remote sensing big data management and processing
    Wang, Lizhe
    Ma, Yan
    Yan, Jining
    Chang, Victor
    Zomaya, Albert Y.
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 78 : 353 - 368
  • [9] Deep learning for processing and analysis of remote sensing big data: a technical review
    Zhang, Xin
    Zhou, Ya'nan
    Luo, Jiancheng
    [J]. BIG EARTH DATA, 2022, 6 (04) : 527 - 560
  • [10] Performance prediction of parallel computing models to analyze cloud-based big data applications
    Shen, Chao
    Tong, Weiqin
    Choo, Kim-Kwang Raymond
    Kausar, Samina
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2018, 21 (02): : 1439 - 1454