Data Analysis of Weather Data Using Hadoop Technology

被引:7
|
作者
Thierno, Diallo [1 ]
Oury, Mamadou [1 ]
Singh, Archana [1 ]
机构
[1] Amity Univ, Noida, Uttar Pradesh, India
来源
关键词
Big Data; Hadoop; Weather data; Map reduction;
D O I
10.1007/978-981-10-5544-7_71
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the present age, all the real business forms comprise of colossal or huge information. As per the reports in the most recent 3 years, 90% of information was made from the utilitarian modules. The information is advancing exponentially, and the IT databases are moving to the capacity in terabytes along with these lines venturing into the period of huge information. The paper, investigates the progressions in different parameters of climate conditions like temperature, precipitation, snowfall, and so forth in the Pannonian Basin (focal Europe) and other comparative districts, from 1900 to 2014 with a base dataset containing day by day estimations by the climate stations arranged close to our purpose of examination. We have utilized the Hadoop innovation to actualize the weather data. For map reduction, we have utilized Apache PIG, and information is pictured by utilizing Python technology. The data results show the visualization Flot of weather data.
引用
收藏
页码:723 / 730
页数:8
相关论文
共 50 条
  • [21] Integrating of data using the Hadoop and R
    Uskenbayeva, Raissa
    Kuandykov, Abu
    Cho, Young Im
    Temirbolatova, Tolganay
    Amanzholova, Saule
    Kozhamzharova, Dinara
    10TH INTERNATIONAL CONFERENCE ON FUTURE NETWORKS AND COMMUNICATIONS (FNC 2015) / THE 12TH INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS AND PERVASIVE COMPUTING (MOBISPC 2015) AFFILIATED WORKSHOPS, 2015, 56 : 145 - 149
  • [22] USING DATA MINING TECHNOLOGY FOR STUDENT DATA ANALYSIS
    Zuka, Rita
    Krasts, Juris
    Rozevskis, Uldis
    NEW CHALLENGES OF ECONOMIC AND BUSINESS DEVELOPMENT - 2017: DIGITAL ECONOMY, 2017, : 755 - 763
  • [23] Sentimental Analysis of Twitter Data on Hadoop
    Choudhury, Jayanta
    Pandey, Chetan
    Saxena, Anuj
    COMPUTING, COMMUNICATION AND SIGNAL PROCESSING, ICCASP 2018, 2019, 810 : 457 - 469
  • [24] Analysis and Optimization of Data Import with Hadoop
    Xu, Weijia
    Luo, Wei
    Woodward, Nicholas
    2012 IEEE 26TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS & PHD FORUM (IPDPSW), 2012, : 1058 - 1066
  • [25] HTSeq-Hadoop: Extending HTSeq for Massively Parallel Sequencing Data Analysis using Hadoop
    Siretskiy, Alexey
    Spjuth, Ola
    2014 IEEE 10TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), VOL 1, 2014, : 317 - 323
  • [26] Twitter Data Analysis Using Hadoop and 'R' and Emotional Analysis Using Optimized SVNN
    Kumar, K. Sailaja
    Manoj, H. K.
    Geetha, D. Evangelin
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2023, 44 (01): : 485 - 499
  • [27] A Big Data Framework for Mining Sensor Data Using Hadoop
    El-Shafeiy, Engy A.
    El-Desouky, Ali I.
    STUDIES IN INFORMATICS AND CONTROL, 2017, 26 (03): : 365 - 376
  • [28] The Role of Hadoop Technology in the Implementation of Big Data Concept
    Stupar, Savo
    Car, Mirha Bico
    Sahic, Elvir
    NEW TECHNOLOGIES, DEVELOPMENT AND APPLICATION, 2019, 42 : 254 - 261
  • [29] The Hadoop Technology Applies in Power Big Data Platform
    Hu, Jianyong
    Chen, Jilin
    Xie, Mei
    Gao, Bo
    Yu, Zhihong
    Yan, Jianfeng
    Lv, Ying
    PROCEEDINGS OF THE 2017 2ND INTERNATIONAL CONFERENCE ON AUTOMATION, MECHANICAL AND ELECTRICAL ENGINEERING (AMEE 2017), 2017, 87 : 113 - 116
  • [30] Power Big Data platform Based on Hadoop Technology
    Chen, Jilin
    Liu, Nana
    Chen, Yong
    Qiu, Weijiang
    PROCEEDINGS OF THE 2016 6TH INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS, ENVIRONMENT, BIOTECHNOLOGY AND COMPUTER (MMEBC), 2016, 88 : 571 - 576