Novel Weather Data Analysis Using Hadoop and MapReduce - A Case Study

被引:0
|
作者
Suryanarayana, V. [1 ,2 ]
Sathish, B. S. [1 ,2 ]
Ranganayakulu, A. [1 ,2 ]
Ganesan, P. [3 ]
机构
[1] Ramachandra Coll Engn, Dept CSE, Eluru, Andhra Pradesh, India
[2] Ramachandra Coll Engn, Dept ECE, Eluru, Andhra Pradesh, India
[3] VJIT, Dept ECE, Hyderabad, Telangana, India
关键词
Meteorology; Weather forecasting; Map Reduce; Hadoop; Big data; Data Mining;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays analyzing data of very large amount has become a big challenge. Data could be medical, scientific, climatically, meteorological, marketing or fmancial. Techniques of Data mining are used for extraction of unpledged material from large data set. Weather forecasting can be preferred to help many important sectors which are affected by climate like agriculture, air traffic, water resources, and tourism. Weather forecasting is an area of meteorology which is performed by accumulating data from various sources related to the present condition of the weather like rainfall, temperate, wind, and fog. It is the main challenging task for the scientists. Hadoop and MapReduce considered as the important techniques used to analyze a large data set. This paper develops a system that adopts the historical weather data of a region it applies the MapReduce and Hadoop methods to analyze this data.
引用
收藏
页码:204 / 207
页数:4
相关论文
共 50 条
  • [1] Data Analysis using Hadoop MapReduce Environment
    Merla, PrathyushaRani
    Liang, Yiheng
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 4783 - 4785
  • [2] Data Analysis of Weather Data Using Hadoop Technology
    Thierno, Diallo
    Oury, Mamadou
    Singh, Archana
    [J]. SMART COMPUTING AND INFORMATICS, 2018, 77 : 723 - 730
  • [3] Clustering on Big Data Using Hadoop MapReduce
    Akthar, Nadeem
    Ahamad, Mohd Vasim
    Khan, Shahbaz
    [J]. 2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 789 - 795
  • [4] Big Data Analysis of Indian Premier League using Hadoop and MapReduce
    Paul, Rajdeep
    [J]. 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE IN DATA SCIENCE (ICCIDS), 2017,
  • [5] Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
    Chiang, Dai-Lun
    Wang, Sheng-Kuan
    Wang, Yu-Ying
    Lin, Yi-Nan
    Hsieh, Tsang-Yen
    Yang, Cheng-Ying
    Shen, Victor R. L.
    Ho, Hung-Wei
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2021, 35 (01) : 80 - 104
  • [6] Improving Hadoop MapReduce Performance with Data Compression: A Study using Wordcount Job
    Rattanaopas, Kritwara
    Kaewkeeree, Sureerat
    [J]. 2017 14TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2017, : 564 - 567
  • [7] An approach for MapReduce based Log analysis using Hadoop
    Hingave, Hemant
    Ingle, Rasika
    [J]. 2015 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION SYSTEMS (ICECS), 2015, : 1264 - 1268
  • [8] MapReduce Based Analysis of Sample Applications Using Hadoop
    Ghazi, Mohd Rehan
    Raghava, N. S.
    [J]. APPLICATIONS OF COMPUTING AND COMMUNICATION TECHNOLOGIES, ICACCT 2018, 2018, 899 : 34 - 44
  • [9] Sentiment analysis using semantic similarity and Hadoop MapReduce
    Youness Madani
    Mohammed Erritali
    Jamaa Bengourram
    [J]. Knowledge and Information Systems, 2019, 59 : 413 - 436
  • [10] Sentiment analysis using semantic similarity and Hadoop MapReduce
    Madani, Youness
    Erritali, Mohammed
    Bengourram, Jamaa
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2019, 59 (02) : 413 - 436