A HADOOP-BASED DISTRIBUTED FRAMEWORK FOR EFFICIENT MANAGING AND PROCESSING BIG REMOTE SENSING IMAGES

被引:8
|
作者
Wang, C. [1 ]
Hu, F. [2 ,3 ]
Hu, X. [1 ]
Zhao, S. [4 ]
Wen, W.
Yang, C. [2 ,3 ]
机构
[1] Natl Adm Surveying Mapping & Geoinformat China, Hainan Geomat Ctr, Haikou 570203, Hainan, Peoples R China
[2] George Mason Univ, Dept Geog & GeoInformat Sci, Fairfax, VA 22030 USA
[3] George Mason Univ, Ctr Intelligent Spatial Comp, Fairfax, VA 22030 USA
[4] Natl Adm Surveying Mapping & Geoinformat China, Inst Photogrammetry 4, Haikou 570203, Hainan, Peoples R China
关键词
Remote Sensing; Image Processing; HDFS; MapReduce; GIS; Parallel Computing;
D O I
10.5194/isprsannals-II-4-W2-63-2015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Various sensors from airborne and satellite platforms are producing large volumes of remote sensing images for mapping, environmental monitoring, disaster management, military intelligence, and others. However, it is challenging to efficiently storage, query and process such big data due to the data- and computing-intensive issues. In this paper, a Hadoop-based framework is proposed to manage and process the big remote sensing data in a distributed and parallel manner. Especially, remote sensing data can be directly fetched from other data platforms into the Hadoop Distributed File System ( HDFS). The Orfeo toolbox, a ready-to-use tool for large image processing, is integrated into MapReduce to provide affluent image processing operations. With the integration of HDFS, Orfeo toolbox and MapReduce, these remote sensing images can be directly processed in parallel in a scalable computing environment. The experiment results show that the proposed framework can efficiently manage and process such big remote sensing data.
引用
下载
收藏
页码:63 / 66
页数:4
相关论文
共 50 条
  • [21] Design of Hadoop-based Framework for Analytics of Large Synchrophasor Datasets
    Edwards, Matthew
    Rambani, Aseem
    Zhu, Yifeng
    Musavi, Mohamad
    COMPLEX ADAPTIVE SYSTEMS 2012, 2012, 12 : 254 - 258
  • [22] Design and Implement a MapReduce Framework for Executing Standalone Software Packages in Hadoop-based Distributed Environmentsn
    Chen, Chao-Chun
    Hung, Min-Hsiung
    Giang, Nguyen Huu Tinh
    Lin, Hsuan-Chun
    Lin, Tzu-Chao
    SMART SCIENCE, 2013, 1 (02) : 99 - 107
  • [23] An improved chaotic image encryption algorithm using Hadoop-based MapReduce framework for massive remote sensed images in parallel IoT applications
    Al-Khasawneh, Mahmoud Ahmad
    Uddin, Irfan
    Shah, Syed Atif Ali
    Khasawneh, Ahmad M.
    Abualigah, Laith
    Mahmoud, Marwan
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (02): : 999 - 1013
  • [24] Big Earth Observation Data Integration in Remote Sensing Based on a Distributed Spatial Framework
    Cheng, Yinyi
    Zhou, Kefa
    Wang, Jinlin
    Yan, Jining
    REMOTE SENSING, 2020, 12 (06)
  • [25] SSFile: A novel column-store for efficient data analysis in Hadoop-based distributed systems
    Son, Jihoon
    Ryu, Hyoseok
    Yi, Sungmin
    Chung, Yon Dohn
    INFORMATION SCIENCES, 2015, 316 : 68 - 86
  • [26] A Hadoop based Framework to Process Geo-distributed Big Data
    Cavallo, Marco
    Cusma', Lorenzo
    Di Modica, Giuseppe
    Polito, Carmelo
    Tomarchio, Orazio
    PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND SERVICES SCIENCE, VOL 1 (CLOSER), 2016, : 178 - 185
  • [27] MC Framework: High-performance Distributed Framework for Standalone Data Analysis Packages over Hadoop-based Cloud
    Chen, Chao-Chun
    Giang, Nguyen Huu Tinh
    Lin, Tzu-Chao
    Hung, Min-Hsiung
    2013 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING (GRC), 2013, : 27 - 32
  • [28] Efficient Big Data Processing in Hadoop MapReduce
    Dittrich, Jens
    Quiane-Ruiz, Jorge-Arnulfo
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (12): : 2014 - 2015
  • [29] A Hadoop-Based Visualization and Diagnosis Framework for Earth Science Data
    Zhou, Shujia
    Yang, Xi
    Li, Xiaowen
    Matsui, Toshihisa
    Liu, Si
    Sun, Xian-He
    Tao, Weikuo
    PROCEEDINGS 2015 IEEE INTERNATIONAL CONFERENCE ON BIG DATA, 2015, : 1972 - 1977
  • [30] A Hadoop-Based Framework for Large-Scale Landmine Detection Using Ubiquitous Big Satellite Imaging Data
    El-Kazzaz, Sahar
    El-Mahdy, Ahmed
    23RD EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2015), 2015, : 274 - 278