A HADOOP-BASED DISTRIBUTED FRAMEWORK FOR EFFICIENT MANAGING AND PROCESSING BIG REMOTE SENSING IMAGES

被引:8
|
作者
Wang, C. [1 ]
Hu, F. [2 ,3 ]
Hu, X. [1 ]
Zhao, S. [4 ]
Wen, W.
Yang, C. [2 ,3 ]
机构
[1] Natl Adm Surveying Mapping & Geoinformat China, Hainan Geomat Ctr, Haikou 570203, Hainan, Peoples R China
[2] George Mason Univ, Dept Geog & GeoInformat Sci, Fairfax, VA 22030 USA
[3] George Mason Univ, Ctr Intelligent Spatial Comp, Fairfax, VA 22030 USA
[4] Natl Adm Surveying Mapping & Geoinformat China, Inst Photogrammetry 4, Haikou 570203, Hainan, Peoples R China
关键词
Remote Sensing; Image Processing; HDFS; MapReduce; GIS; Parallel Computing;
D O I
10.5194/isprsannals-II-4-W2-63-2015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Various sensors from airborne and satellite platforms are producing large volumes of remote sensing images for mapping, environmental monitoring, disaster management, military intelligence, and others. However, it is challenging to efficiently storage, query and process such big data due to the data- and computing-intensive issues. In this paper, a Hadoop-based framework is proposed to manage and process the big remote sensing data in a distributed and parallel manner. Especially, remote sensing data can be directly fetched from other data platforms into the Hadoop Distributed File System ( HDFS). The Orfeo toolbox, a ready-to-use tool for large image processing, is integrated into MapReduce to provide affluent image processing operations. With the integration of HDFS, Orfeo toolbox and MapReduce, these remote sensing images can be directly processed in parallel in a scalable computing environment. The experiment results show that the proposed framework can efficiently manage and process such big remote sensing data.
引用
收藏
页码:63 / 66
页数:4
相关论文
共 50 条
  • [1] Hadoop-based parallel algorithm for data mining in remote sensing images
    Wang Y.
    Liu Y.
    Jing W.
    [J]. International Journal of Performability Engineering, 2019, 15 (11): : 2860 - 2870
  • [2] An efficient Hadoop-based brain tumor detection framework using big data analytic
    Kaur Chahal, Prabhjot
    Pandey, Shreelekha
    [J]. SOFTWARE-PRACTICE & EXPERIENCE, 2022, 52 (03): : 805 - 818
  • [3] BIG-BIO: - Big Data Hadoop-based Analytic Cluster Framework for Bioinformatics
    Abul Seoud, Rania Ahmed Abdel Azeem
    Mahmoud, Mahmoud Ahmed
    Ramadan, Amr Essam Eldin
    [J]. 2017 INTERNATIONAL CONFERENCE ON INFORMATICS, HEALTH & TECHNOLOGY (ICIHT), 2017,
  • [4] Hadoop-based Distributed Computing Algorithms for Healthcare and Clinic Data Processing
    Ni, Jun
    Chen, Ying
    Sha, Jie
    Zhang, Minghuan
    [J]. 2015 EIGHTH INTERNATIONAL CONFERENCE ON INTERNET COMPUTING FOR SCIENCE AND ENGINEERING (ICICSE), 2015, : 188 - 193
  • [5] A New Distributed Histogram Equalization Processing Remote Sensing Images based on MapReduce Framework
    Ji, Lipeng
    Hu, Xiaohui
    [J]. PROCEEDINGS OF THE 2017 INTERNATIONAL CONFERENCE ON MECHANICAL, ELECTRONIC, CONTROL AND AUTOMATION ENGINEERING (MECAE 2017), 2017, 61 : 156 - 159
  • [6] Investigation on Hadoop-based distributed search engine
    Chen, Ning
    Xiangyang, Chai
    [J]. Journal of Software Engineering, 2014, 8 (03): : 127 - 131
  • [7] Hadoop-based analytic framework for cyber forensics
    Chhabra, Gurpal Singh
    Singh, Varinderpal
    Singh, Maninder
    [J]. INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2018, 31 (15)
  • [8] A Hadoop-Based Packet Trace Processing Tool
    Lee, Yeonhee
    Kang, Wonchul
    Lee, Youngseok
    [J]. TRAFFIC MONITORING AND ANALYSIS: THIRD INTERNATIONAL WORKSHOP, TMA 2011, 2011, 6613 : 51 - 63
  • [9] A Comparison of Big Remote Sensing Data Processing with Hadoop MapReduce and Spark
    Chebbi, I.
    Boulila, W.
    Mellouli, N.
    Lamolle, M.
    Farah, I. R.
    [J]. 2018 4TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP), 2018,
  • [10] Hadoop-Based Big Data Distributions: A Comparative Study
    Hamdaoui, Ikram
    El Fissaoui, Mohamed
    El Makkaoui, Khalid
    El Allali, Zakaria
    [J]. EMERGING TRENDS IN INTELLIGENT SYSTEMS & NETWORK SECURITY, 2023, 147 : 242 - 252