A HADOOP-BASED DISTRIBUTED FRAMEWORK FOR EFFICIENT MANAGING AND PROCESSING BIG REMOTE SENSING IMAGES

被引:8
|
作者
Wang, C. [1 ]
Hu, F. [2 ,3 ]
Hu, X. [1 ]
Zhao, S. [4 ]
Wen, W.
Yang, C. [2 ,3 ]
机构
[1] Natl Adm Surveying Mapping & Geoinformat China, Hainan Geomat Ctr, Haikou 570203, Hainan, Peoples R China
[2] George Mason Univ, Dept Geog & GeoInformat Sci, Fairfax, VA 22030 USA
[3] George Mason Univ, Ctr Intelligent Spatial Comp, Fairfax, VA 22030 USA
[4] Natl Adm Surveying Mapping & Geoinformat China, Inst Photogrammetry 4, Haikou 570203, Hainan, Peoples R China
关键词
Remote Sensing; Image Processing; HDFS; MapReduce; GIS; Parallel Computing;
D O I
10.5194/isprsannals-II-4-W2-63-2015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Various sensors from airborne and satellite platforms are producing large volumes of remote sensing images for mapping, environmental monitoring, disaster management, military intelligence, and others. However, it is challenging to efficiently storage, query and process such big data due to the data- and computing-intensive issues. In this paper, a Hadoop-based framework is proposed to manage and process the big remote sensing data in a distributed and parallel manner. Especially, remote sensing data can be directly fetched from other data platforms into the Hadoop Distributed File System ( HDFS). The Orfeo toolbox, a ready-to-use tool for large image processing, is integrated into MapReduce to provide affluent image processing operations. With the integration of HDFS, Orfeo toolbox and MapReduce, these remote sensing images can be directly processed in parallel in a scalable computing environment. The experiment results show that the proposed framework can efficiently manage and process such big remote sensing data.
引用
下载
收藏
页码:63 / 66
页数:4
相关论文
共 50 条
  • [41] An Efficient Hadoop-Based Framework for Data Storage and Fault Recovering in Large-Scale Multimedia Sensor Networks
    Saad, Ghina
    Harb, Hassan
    Abouaissa, Abdelhafid
    Idoumghar, Lhassane
    Charara, Nour
    2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 316 - 321
  • [42] A Framework for Remote Sensing Images Processing Using Deep Learning Techniques
    Cresson, Remi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (01) : 25 - 29
  • [43] Efficient Object Detection Framework and Hardware Architecture for Remote Sensing Images
    Li, Lin
    Zhang, Shengbing
    Wu, Juan
    REMOTE SENSING, 2019, 11 (20)
  • [44] A HADOOP-BASED DATA PROCESSING PLATFORM FOR FRESH AGRO-PRODUCTS TRACEABILITY
    Xu, Mark
    Siraj, Sajid
    Qi, Lin
    PROCEEDINGS OF THE EUROPEAN CONFERENCE ON DATA MINING 2015 AND INTERNATIONAL CONFERENCES ON INTELLIGENT SYSTEMS AND AGENTS 2015 AND THEORY AND PRACTICE IN MODERN COMPUTING 2015, 2015, : 37 - 44
  • [45] An Iterative Hadoop-Based Ensemble Data Classification Model on Distributed Medical Databases
    Bikku, Thulasi
    Nandam, Sambasiva Rao
    Akepogu, Ananda Rao
    PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INFORMATICS, ICCII 2016, 2017, 507 : 341 - 351
  • [46] Efficient dimension reduction of hyperspectral images for big data remote sensing applications
    Garcia-Salgado, Beatriz P.
    Ponomaryov, Volodymyr, I
    Sadovnychiy, Sergiy
    Reyes-Reyes, Rogelio
    JOURNAL OF APPLIED REMOTE SENSING, 2020, 14 (03)
  • [47] A Cluster-Based Partition Method of Remote Sensing Data for Efficient Distributed Image Processing
    Wang, Lei
    Yu, Bo
    Chen, Fang
    Li, Congrong
    Li, Bin
    Wang, Ning
    REMOTE SENSING, 2022, 14 (19)
  • [48] MIPr - a Framework for Distributed Image Processing Using Hadoop
    Sozykin, Andrey
    Epanchintsev, Timofei
    2015 9TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2015, : 35 - 39
  • [49] HADOOP-BASED DISTRIBUTED SYSTEM FOR ONLINE PREDICTION OF AIR POLLUTION BASED ON SUPPORT VECTOR MACHINE
    Ghaemi, Z.
    Farnaghi, M.
    Alimohammadi, A.
    INTERNATIONAL CONFERENCE ON SENSORS & MODELS IN REMOTE SENSING & PHOTOGRAMMETRY, 2015, 41 (W5): : 215 - 219
  • [50] Cludoop: An Efficient Distributed Density-Based Clustering for Big Data Using Hadoop
    Yu, Yanwei
    Zhao, Jindong
    Wang, Xiaodong
    Wang, Qin
    Zhang, Yonggang
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2015,