The Research of Meteorological Data Mining Using Discrete Bayesian Networks Classifier Based on Hadoop

被引:0
|
作者
Zhang Yongjun [1 ]
Sun Jing [1 ]
机构
[1] BUPT, Beijing, Peoples R China
关键词
Bayesian Networks; Predictive Ability; Classified Prediction; Data Mining; Hadoop;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The method of Native Bayesian classification data mining in weather forecast has some defects, such as there is not independent of each other between predictors, but a certain relevance which results in the decrease of prediction accuracy. This paper explores an improved algorithm which is based on the theory of discrete Bayesian Networks, and combines with Hadoop distributed file system and parallel processing programming models to predict rainfall. The experiments show that the improved algorithm not only makes the classification prediction more reliable but also improves the efficiency greatly. In addition, it provides a solution of huge amounts of data mining in the other fields.
引用
收藏
页码:996 / 1001
页数:6
相关论文
共 50 条
  • [41] Distributed web mining using Bayesian networks from multiple data streams
    Chen, R
    Sivakumar, K
    Kargupta, H
    2001 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2001, : 75 - 82
  • [42] Using Bayesian networks to build data mining applications for a semiconductor cleaning process
    Chen, Ruey-Shun
    Chang, Chan-Chine
    INTERNATIONAL JOURNAL OF MATERIALS & PRODUCT TECHNOLOGY, 2007, 30 (04): : 386 - 407
  • [43] Research on Data Mining in Social Networks based on User Features
    Kong, Liyun
    PROCEEDINGS OF THE 2014 2ND INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL SCIENCE, HUMANITIES AND MANAGEMENT, 2015, 12 : 448 - 450
  • [44] Research and analysis of big data based on hadoop
    Liu, Xiaohong
    Wang, Wangang
    Zhu, Guangfu
    Boletin Tecnico/Technical Bulletin, 2017, 55 (04): : 382 - 386
  • [45] Hybrid Bayesian networks: making the hybrid Bayesian classifier robust to missing training data
    Woody, NA
    Brown, SD
    JOURNAL OF CHEMOMETRICS, 2003, 17 (05) : 266 - 273
  • [46] Mining the Associated Patterns in Big Data Using Hadoop Cluster
    Asha, P.
    Jacob, T. Prem
    Pravin, A.
    Asbern, A.
    INTERNATIONAL CONFERENCE ON INTELLIGENT DATA COMMUNICATION TECHNOLOGIES AND INTERNET OF THINGS, ICICI 2018, 2019, 26 : 1255 - 1263
  • [47] Application of Bayesian networks and data mining to biomedical problems
    Kammerdiner, Alla R.
    Gupal, Anatoliy M.
    Pardalos, Panos M.
    DATA MINING, SYSTEMS ANALYSIS, AND OPTIMIZATION IN BIOMEDICINE, 2007, 953 : 132 - +
  • [48] Mining Algorithm for Association Rules in Big Data Based on Hadoop
    Fu, Chunhua
    Wang, Xiaojing
    Zhang, Lijun
    Qiao, Liying
    ADVANCES IN MATERIALS, MACHINERY, ELECTRONICS II, 2018, 1955
  • [49] Learning Discrete Bayesian Networks from Continuous Data
    Chen, Yi-Chun
    Wheeler, Tim A.
    Kochenderfer, Mykel J.
    JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2017, 59 : 103 - 132
  • [50] A fault mining method based on Bayesian networks
    Zhang, J. (jian_fei_zhang@163.com), 1600, ICIC Express Letters Office, Tokai University, Kumamoto Campus, 9-1-1, Toroku, Kumamoto, 862-8652, Japan (07):