High Performance Processing of Satellite Data Using Distributed and Parallel Computing Techniques

被引:0
|
作者
Damahe, Lalit B. [1 ]
Bramhe, Sanket S. [1 ]
Fursule, Nilay C. [1 ]
Shirbhate, Ram D. [1 ]
Ajmire, Pournima S. [1 ]
Kumar, Girish [2 ]
机构
[1] Yeshwantrao Chavan Coll Engn, Dept Comp Technol, Nagpur, Maharashtra, India
[2] ISRO, RRSC Cent, Nagpur, Maharashtra, India
来源
关键词
APACHE SPARK; DISTRIBUTIVE COMPUTING; HIGH-PERFORMANCE COMPUTING; PARALLEL COMPUTING; SATELLITE DATA;
D O I
10.21786/bbrc/13.14/92
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
In today's world of technological revolution when the volume of the data is increasing enormously coincided with the growth in technology, it has become crucial to process and store data adroitly. Due to increasing demand of high processing speed, the traditional methods of processing satellite data have become incompetent. This propelled the need for high performance computing, which is the ability to process data and complex calculations at an accelerated speed effectively and accurately. It takes prolonged time for batch processing of satellite images which acts as the foundation of analysis developments in many technological and geological fields. In this paper, presented, a proposed distributed and parallel computation solutions for satellite image processing and computation of various indices normalized difference vegetation index that improves the performance of the system. By taking advantage of apache spark and cluster computing techniques real-time high-speed stream processing of satellite data is achieved. Some main features are discussed comprehensively about apache spark cluster formation, distributive and parallel computing methodologies, calculation and processing of indices with satellite data of Landsat 5. Also, python programs for processing of satellite data of Landsat 5 are executed and their results are presented in terms of processing speed and time.
引用
收藏
页码:404 / 409
页数:6
相关论文
共 50 条
  • [21] Parallel Processing Techniques For High Performance Image Processing Applications
    Hemnani, Monika
    [J]. 2016 IEEE STUDENTS' CONFERENCE ON ELECTRICAL, ELECTRONICS AND COMPUTER SCIENCE (SCEECS), 2016,
  • [22] Applying Parallel Programming and High Performance Computing To Speed up Data Mining Processing
    Zhang, Ruijian
    [J]. 2017 16TH IEEE/ACIS INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCE (ICIS 2017), 2017, : 279 - 283
  • [23] Distributed Data-Parallel Computing Using a High-Level Programming Language
    Isard, Michael
    Yu, Yuan
    [J]. ACM SIGMOD/PODS 2009 CONFERENCE, 2009, : 987 - 994
  • [24] Optimizing large-scale data processing in the digital economy using high-performance computing techniques
    Dong, Fei
    [J]. Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [25] A High Performance Computing Web Search Engine Based on Big Data and Parallel Distributed Models
    Ma, Jun
    [J]. Informatica (Slovenia), 2024, 48 (20): : 27 - 38
  • [26] PARALLEL COMPUTING WITH DISTRIBUTED SHARED DATA
    HSU, MC
    [J]. PROCEEDINGS : FIFTH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, 1989, : 485 - 485
  • [27] Parallel and distributed computing for data mining
    Zomaya, AY
    El-Ghazawi, T
    Frieder, O
    [J]. IEEE CONCURRENCY, 1999, 7 (04): : 11 - 13
  • [28] Parallel Earth Data Tasks Processing on a Distributed Cloud Based Computing Architecture
    Nandra, Constantin
    Bacu, Victor
    Gorgan, Dorian
    [J]. 2017 21ST INTERNATIONAL CONFERENCE ON CONTROL SYSTEMS AND COMPUTER SCIENCE (CSCS), 2017, : 677 - 684
  • [29] Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing
    Wu, Zebin
    Sun, Jin
    Zhang, Yi
    Wei, Zhihui
    Chanussot, Jocelyn
    [J]. PROCEEDINGS OF THE IEEE, 2021, 109 (08) : 1282 - 1305
  • [30] Parallel language processing system for high-performance computing
    Yamanaka, E
    Shindo, T
    [J]. FUJITSU SCIENTIFIC & TECHNICAL JOURNAL, 1997, 33 (01): : 39 - 51