The Research of Meteorological Data Mining Using Discrete Bayesian Networks Classifier Based on Hadoop

被引:0
|
作者
Zhang Yongjun [1 ]
Sun Jing [1 ]
机构
[1] BUPT, Beijing, Peoples R China
关键词
Bayesian Networks; Predictive Ability; Classified Prediction; Data Mining; Hadoop;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The method of Native Bayesian classification data mining in weather forecast has some defects, such as there is not independent of each other between predictors, but a certain relevance which results in the decrease of prediction accuracy. This paper explores an improved algorithm which is based on the theory of discrete Bayesian Networks, and combines with Hadoop distributed file system and parallel processing programming models to predict rainfall. The experiments show that the improved algorithm not only makes the classification prediction more reliable but also improves the efficiency greatly. In addition, it provides a solution of huge amounts of data mining in the other fields.
引用
收藏
页码:996 / 1001
页数:6
相关论文
共 50 条
  • [31] Massive Online Shopping Data Mining based on Hadoop
    Sun, Hong
    Li, Cunjin
    Yin, Zhong
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 3277 - 3282
  • [32] Data mining association rule algorithm based on Hadoop
    Huang Suyu
    PROCEEDINGS OF 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA 2015), 2015, : 349 - 352
  • [33] A new data mining algorithm based on MapReduce and hadoop
    Yang, Xianfeng
    Lian, Liming
    International Journal of Signal Processing, Image Processing and Pattern Recognition, 2014, 7 (02) : 131 - 142
  • [34] METECLOUD: A PRIVATE CLOUD PLATFORM FOR METEOROLOGICAL DATA STORAGE USING HADOOP
    Xue Shengjun
    Xu Xiaolong
    Wang Delong
    Zhang Jie
    Ji Feng
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2013, 6 (02): : 648 - 663
  • [35] A Survey on Clustering based Meteorological Data Mining
    Tian, Wei
    Zheng, Yuhui
    Yang, Runzhi
    Ji, Sai
    Wang, Jin
    INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2014, 7 (06): : 229 - 240
  • [36] Metecloud: A private cloud platform for meteorological data storage using hadoop
    Xiaolong, X. (xlxu1988@gmail.com), 1600, Exeley Inc (06):
  • [37] An Agent Based Rough Classifier for Data Mining
    Abu Bakar, Azuraliza
    Othman, Zulaiha Ali
    Hamdan, Abdul Razak
    Yusof, Rozianiwati
    Ismail, Ruhaizan
    ISDA 2008: EIGHTH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS DESIGN AND APPLICATIONS, VOL 1, PROCEEDINGS, 2008, : 145 - 151
  • [38] A NOVEL MASS METEOROLOGICAL DATA STORAGE SYSTEM BASED ON HADOOP ECOSYSTEM
    Ji, Quanpeng
    FRESENIUS ENVIRONMENTAL BULLETIN, 2021, 30 (05): : 5332 - 5339
  • [39] Design and Implementation of Meteorological Big Data Platform Based on Hadoop and Elasticsearch
    Yin, He
    Deng Fengdong
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2019, : 705 - 710
  • [40] Design and Test of GIS Platform for Meteorological Data Analysis Based on Hadoop
    Li T.
    Feng Z.
    Sun S.
    Cheng W.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2019, 50 (01): : 180 - 188