Data Analysis of Weather Data Using Hadoop Technology

被引:7
|
作者
Thierno, Diallo [1 ]
Oury, Mamadou [1 ]
Singh, Archana [1 ]
机构
[1] Amity Univ, Noida, Uttar Pradesh, India
来源
关键词
Big Data; Hadoop; Weather data; Map reduction;
D O I
10.1007/978-981-10-5544-7_71
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the present age, all the real business forms comprise of colossal or huge information. As per the reports in the most recent 3 years, 90% of information was made from the utilitarian modules. The information is advancing exponentially, and the IT databases are moving to the capacity in terabytes along with these lines venturing into the period of huge information. The paper, investigates the progressions in different parameters of climate conditions like temperature, precipitation, snowfall, and so forth in the Pannonian Basin (focal Europe) and other comparative districts, from 1900 to 2014 with a base dataset containing day by day estimations by the climate stations arranged close to our purpose of examination. We have utilized the Hadoop innovation to actualize the weather data. For map reduction, we have utilized Apache PIG, and information is pictured by utilizing Python technology. The data results show the visualization Flot of weather data.
引用
下载
收藏
页码:723 / 730
页数:8
相关论文
共 50 条
  • [31] Weather data mining using independent component analysis
    Basak, J
    Sudarshan, A
    Trivedi, D
    Santhanam, MS
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 239 - 253
  • [32] Analysis of weather data using various regression algorithms
    Jahnavi, Yeturu
    International Journal of Data Science, 2019, 4 (02) : 117 - 141
  • [34] Predictive Analysis of Diabetic Patient Data Using Machine Learning and Hadoop
    Kalyankar, Gauri D.
    Poojara, Shivananda R.
    Dharwadkar, Nagaraj V.
    2017 INTERNATIONAL CONFERENCE ON I-SMAC (IOT IN SOCIAL, MOBILE, ANALYTICS AND CLOUD) (I-SMAC), 2017, : 619 - 624
  • [35] Comparison and Analysis of RDF Data Using SPARQL, HIVE, PIG in Hadoop
    Chandel, Anshul
    Garg, Deepak
    COMPUTING AND NETWORK SUSTAINABILITY, 2017, 12 : 361 - 369
  • [36] Real-time Twitter data analysis using Hadoop ecosystem
    Rodrigues, Anisha P.
    Chiplunkar, Niranjan N.
    COGENT ENGINEERING, 2018, 5 (01): : 1 - 16
  • [37] Big Data Analysis of Indian Premier League using Hadoop and MapReduce
    Paul, Rajdeep
    2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE IN DATA SCIENCE (ICCIDS), 2017,
  • [38] Analysis of DNA Data Using Hadoop Distributed File System.
    Senthilkumar, M.
    Ilango, P.
    RESEARCH JOURNAL OF PHARMACEUTICAL BIOLOGICAL AND CHEMICAL SCIENCES, 2016, 7 (03): : 796 - 803
  • [39] Scaling Archived Social Media Data Analysis using a Hadoop Cloud
    Conejero, Javier
    Burnap, Peter
    Rana, Omer
    Morgan, Jeffrey
    2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2013), 2013, : 685 - 692
  • [40] Evaluation and Analysis of Capacity Scheduler and Fair Scheduler in Hadoop Framework on Big Data Technology
    Salman, Muhammad
    Husna, Diyanatul
    Wicaksono, Adhitya
    Ratna, Anak Agung Putri
    AIVR 2018: 2018 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY, 2018, : 1 - 5