High Performance Processing of Satellite Data Using Distributed and Parallel Computing Techniques

被引:0
|
作者
Damahe, Lalit B. [1 ]
Bramhe, Sanket S. [1 ]
Fursule, Nilay C. [1 ]
Shirbhate, Ram D. [1 ]
Ajmire, Pournima S. [1 ]
Kumar, Girish [2 ]
机构
[1] Yeshwantrao Chavan Coll Engn, Dept Comp Technol, Nagpur, Maharashtra, India
[2] ISRO, RRSC Cent, Nagpur, Maharashtra, India
来源
关键词
APACHE SPARK; DISTRIBUTIVE COMPUTING; HIGH-PERFORMANCE COMPUTING; PARALLEL COMPUTING; SATELLITE DATA;
D O I
10.21786/bbrc/13.14/92
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
In today's world of technological revolution when the volume of the data is increasing enormously coincided with the growth in technology, it has become crucial to process and store data adroitly. Due to increasing demand of high processing speed, the traditional methods of processing satellite data have become incompetent. This propelled the need for high performance computing, which is the ability to process data and complex calculations at an accelerated speed effectively and accurately. It takes prolonged time for batch processing of satellite images which acts as the foundation of analysis developments in many technological and geological fields. In this paper, presented, a proposed distributed and parallel computation solutions for satellite image processing and computation of various indices normalized difference vegetation index that improves the performance of the system. By taking advantage of apache spark and cluster computing techniques real-time high-speed stream processing of satellite data is achieved. Some main features are discussed comprehensively about apache spark cluster formation, distributive and parallel computing methodologies, calculation and processing of indices with satellite data of Landsat 5. Also, python programs for processing of satellite data of Landsat 5 are executed and their results are presented in terms of processing speed and time.
引用
收藏
页码:404 / 409
页数:6
相关论文
共 50 条
  • [1] Fast distributed and parallel pre-processing on massive satellite data using grid computing
    Lee, Wongoo
    Choi, Yunsoo
    Shon, Kangryul
    Kim, Jaesoo
    [J]. JOURNAL OF CENTRAL SOUTH UNIVERSITY, 2014, 21 (10) : 3850 - 3855
  • [2] Fast distributed and parallel pre-processing on massive satellite data using grid computing
    Wongoo Lee
    Yunsoo Choi
    Kangryul Shon
    Jaesoo Kim
    [J]. Journal of Central South University, 2014, 21 : 3850 - 3855
  • [3] Fast distributed and parallel pre-processing on massive satellite data using grid computing
    Wongoo Lee
    Yunsoo Choi
    Kangryul Shon
    Jaesoo Kim
    [J]. Journal of Central South University, 2014, 21 (10) : 3850 - 3855
  • [4] High Performance Computing Applications Using Parallel Data Processing Units
    Azadbakht, Keyvan
    Serbanescu, Vlad
    de Boer, Frank
    [J]. FUNDAMENTALS OF SOFTWARE ENGINEERING, FSEN 2015, 2015, 9392 : 191 - 206
  • [5] High performance data processing using distributed computing on the SOLIS project
    Wampler, S
    [J]. ADVANCED TELESCOPE AND INSTRUMENTATION CONTROL SOFTWARE II, 2002, 4848 : 85 - 94
  • [6] Using Java for distributed computing in the Gaia satellite data processing
    William O’Mullane
    Xavier Luri
    Paul Parsons
    Uwe Lammers
    John Hoar
    Jose Hernandez
    [J]. Experimental Astronomy, 2011, 31 : 243 - 258
  • [7] Using Java']Java for distributed computing in the Gaia satellite data processing
    O'Mullane, William
    Luri, Xavier
    Parsons, Paul
    Lammers, Uwe
    Hoar, John
    Hernandez, Jose
    [J]. EXPERIMENTAL ASTRONOMY, 2011, 31 (2-3) : 243 - 258
  • [8] A High-Performance Parallel Approach to Image Processing in Distributed Computing
    Rakhimov, Mekhriddin
    Mamadjanov, Doniyor
    Mukhiddinov, Abulkosim
    [J]. 2020 IEEE 14TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT2020), 2020,
  • [9] Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing
    Ahmad, Awais
    Paul, Anand
    Din, Sadia
    Rathore, M. Mazhar
    Choi, Gyu Sang
    Jeon, Gwanggil
    [J]. INTERNATIONAL JOURNAL OF PARALLEL PROGRAMMING, 2018, 46 (03) : 508 - 527
  • [10] Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing
    Awais Ahmad
    Anand Paul
    Sadia Din
    M. Mazhar Rathore
    Gyu Sang Choi
    Gwanggil Jeon
    [J]. International Journal of Parallel Programming, 2018, 46 : 508 - 527