Cloud-based storage and computing for remote sensing big data: a technical review

被引:14
|
作者
Xu, Chen [1 ,2 ,3 ]
Du, Xiaoping [1 ,2 ]
Fan, Xiangtao [1 ,2 ]
Giuliani, Gregory [4 ]
Hu, Zhongyang [5 ]
Wang, Wei [6 ]
Liu, Jie [6 ]
Wang, Teng [7 ]
Yan, Zhenzhen [1 ,2 ]
Zhu, Junjie [1 ,2 ]
Jiang, Tianyang [8 ]
Guo, Huadong [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Beijing 100094, Peoples R China
[2] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing, Peoples R China
[4] Univ Geneva, Inst Environm Sci GRID Geneva, Geneva, Switzerland
[5] Univ Utrecht, Inst Marine & Atmospher Res Utrecht IMAU, Utrecht, Netherlands
[6] Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing, Peoples R China
[7] Peoples Republ China Telecom Co Ltd, Tianyi Cloud, Guangzhou, Peoples R China
[8] Tsinghua Univ, Dept Comp Sci & Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; big data; cloud computing; data cube; analysis ready data; parallel computing; data model; EARTH DATA; MODEL; ANALYTICS; FRAMEWORK; OPPORTUNITIES; EFFICIENT; LANDSAT; SCIENCE; SYSTEMS;
D O I
10.1080/17538947.2022.2115567
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
The rapid growth of remote sensing big data (RSBD) has attracted considerable attention from both academia and industry. Despite the progress of computer technologies, conventional computing implementations have become technically inefficient for processing RSBD. Cloud computing is effective in activating and mining large-scale heterogeneous data and has been widely applied to RSBD over the past years. This study performs a technical review of cloud-based RSBD storage and computing from an interdisciplinary viewpoint of remote sensing and computer science. First, we elaborate on four critical technical challenges resulting from the scale expansion of RSBD applications, i.e. raster storage, metadata management, data homogeneity, and computing paradigms. Second, we introduce state-of-the-art cloud-based data management technologies for RSBD storage. The unit for manipulating remote sensing data has evolved due to the scale expansion and use of novel technologies, which we name the RSBD data model. Four data models are suggested, i.e. scenes, ARD, data cubes, and composite layers. Third, we summarize recent research on the application of various cloud-based parallel computing technologies to RSBD computing implementations. Finally, we categorize the architectures of mainstream RSBD platforms. This research provides a comprehensive review of the fundamental issues of RSBD for computing experts and remote sensing researchers.
引用
收藏
页码:1417 / 1445
页数:29
相关论文
共 50 条
  • [21] CADRE: A Cloud-Based Data Service for Big Bibliographic Data
    Yan, Xiaoran
    Ruan, Guangchen
    Nikolov, Dimitar
    Hutchinson, Matthew
    Kankanamalage, Chathuri Peli
    Serrette, Ben
    McCombs, James
    Walsh, Alan
    Tuna, Esen
    Pentchev, Valentin
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 4283 - 4292
  • [22] Strategic alignment of Cloud-based Architectures for Big Data
    Schmidt, Rainer
    Moehring, Michael
    [J]. 17TH IEEE INTERNATIONAL ENTERPRISE DISTRIBUTED OBJECT COMPUTING CONFERENCE WORKSHOPS (EDOCW 2013), 2013, : 136 - 143
  • [23] Performance Prediction of Cloud-Based Big Data Applications
    Ardagna, Danilo
    Barbierato, Enrico
    Evangelinou, Athanasia
    Gianniti, Eugenio
    Gribaudo, Marco
    Pinto, Tulio B. M.
    Guimaraes, Anna
    da Silva, Ana Paula Couto
    Almeida, Jussara M.
    [J]. PROCEEDINGS OF THE 2018 ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '18), 2018, : 192 - 199
  • [24] Distributed and Cloud-based Big Data Analytics and Fusion
    Das, Subrata
    [J]. SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION XXII, 2013, 8745
  • [25] Pipeline provenance for cloud-based big data analytics
    Wang, Ruoyu
    Sun, Daniel
    Li, Guoqiang
    Wong, Raymond
    Chen, Shiping
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 2020, 50 (05): : 658 - 674
  • [26] A Cloud-based Network Architecture for Big Data Services
    Zhao, Ming
    Kumar, Arun
    Ali, G. G. Md. Nawaz
    Chong, Peter Han Joo
    [J]. 2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC, 2016, : 654 - 659
  • [27] Efficient Cloud-Based Framework for Big Data Classification
    Pakdel, Rezvan
    Herbert, John
    [J]. PROCEEDINGS 2016 IEEE SECOND INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (BIGDATASERVICE 2016), 2016, : 195 - 201
  • [28] A Ceph-based storage strategy for big gridded remote sensing data
    Tang, Xinyu
    Yao, Xiaochuang
    Liu, Diyou
    Zhao, Long
    Li, Li
    Zhu, Dehai
    Li, Guoqing
    [J]. BIG EARTH DATA, 2022, 6 (03) : 323 - 339
  • [29] Integration of cloud-based storage in BES III computing environment
    Wang, L.
    Hernandez, F.
    Deng, Z.
    [J]. 20TH INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS (CHEP2013), PARTS 1-6, 2014, 513
  • [30] Public Auditing for Big Data Storage in Cloud Computing -- A Survey
    Liu, Chang
    Ranjan, Rajiv
    Zhang, Xuyun
    Yang, Chi
    Georgakopoulos, Dimitrios
    Chen, Jinjun
    [J]. 2013 IEEE 16TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE 2013), 2013, : 1128 - 1135