Towards building a multi-datacenter infrastructure for massive remote sensing image processing

被引:31
|
作者
Zhang, Wanfeng [1 ,3 ]
Wang, Lizhe [1 ,2 ]
Liu, Dingsheng [1 ]
Song, Weijing [1 ]
Ma, Yan [1 ]
Liu, Peng [1 ]
Chen, Dan [2 ]
机构
[1] Chinese Acad Sci, Ctr Earth Observat & Digital Earth, Beijing, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
[3] Chinese Acad Sci, Grad Univ, Beijing, Peoples R China
来源
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE | 2013年 / 25卷 / 12期
基金
中国国家自然科学基金;
关键词
data intensive computing; remote sensing image processing; multi-datacenter infrastructure; cloud computing; CLOUD;
D O I
10.1002/cpe.2966
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Earth observation applications are now facing the challenges of managing and processing massive data sets from multiple sources from large-scale distributed data centers (DCs). To solve this research problem, this paper presents an infrastructure of multiple data centers (MDC) for managing and processing massive remote sensing images. The proposed system is built on both groups of distributed DCs/clusters, which are equipped with DC or cluster resource manager. Access security and information service are introduced to support this architecture of MDC. We collaboratively organized the algorithm, and data belonged to the MDC in the manner of workflow. In practice, we succeeded in working out the concrete problems regarding procedures in processing applications collaboratively and transfer the massive remote sensing dataset fast and with stable cross-MDC. On the basis of the previously mentioned research work, we will investigate the platform integration of MDC. Copyright (c) 2012 John Wiley & Sons, Ltd.
引用
收藏
页码:1798 / 1812
页数:15
相关论文
共 50 条
  • [1] Survivable Virtual Infrastructure Mappings in Multi-datacenter Systems
    Yu, Hongfang
    Sun, Gang
    Qiao, Chunming
    Wang, Jianping
    2013 5TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT), 2013, : 118 - 124
  • [2] Towards Building a Distributed File System for Remote Sensing Image Process
    Li, Zhenju
    Li, Xuejun
    Liu, Tao
    Xie, Jianwei
    PROCEEDINGS OF 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYSIS (ICBDA), 2016, : 311 - 314
  • [3] A Web 2.0-based science gateway for massive remote sensing image processing
    Miao, Yanhua
    Wang, Lizhe
    Liu, Dingsheng
    Ma, Yan
    Zhang, Wanfeng
    Chen, Lajiao
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (09): : 2489 - 2501
  • [4] Digital Image Processing in Remote Sensing
    Fonseca, Leila M. G.
    Namikawa, Laercio M.
    Castejon, Emiliano F.
    2009 TUTORIALS OF THE XXII BRAZILIAN SYMPOSIUM ON COMPUTER GRAPHICS AND IMAGE PROCESSING (SIBGRAPI 2009), 2009, : 59 - 71
  • [5] Processing of hyperspectral remote sensing image
    Li, DR
    Zhang, LP
    INTERNATIONAL SYMPOSIUM ON MULTISPECTRAL IMAGE PROCESSING, 1998, 3545 : 8 - 14
  • [6] Building Extraction from Remote Sensing Image Based on Multi-Module
    Ming Xingtao
    Yang Dehong
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [7] Research on Method for Massive Pixel-level Remote Sensing Image Processing Based on Hadoop
    Wang, Xiaoyu
    Li, Guoqing
    Yu, Wenyang
    Zou, Quan
    MEASUREMENT TECHNOLOGY AND ENGINEERING RESEARCHES IN INDUSTRY, PTS 1-3, 2013, 333-335 : 1224 - 1230
  • [8] A new architecture paradigm for image processing pipeline applied to massive remote sensing data production
    Melet, Olivier
    Masse, Antoine
    Ott, Yannick
    Lassalle, Pierre
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXIV, 2018, 10789
  • [9] DISTRIBUTED RETRIEVAL FOR MASSIVE REMOTE SENSING IMAGE METADATA ON
    Wang, Fengyang
    Wang, Xuezhi
    Cui, Wenjuan
    Xiao, Xiao
    Zhou, Yuanchun
    Li, Jianhui
    2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, : 5909 - 5912
  • [10] Towards Remote Sensing Datasets Collection and Processing
    Semlali, Badreddine Boudriki
    El Amrani, Chaker
    INTERNATIONAL JOURNAL OF EMBEDDED AND REAL-TIME COMMUNICATION SYSTEMS (IJERTCS), 2019, 10 (03): : 49 - 67