A Method For Hybrid Bayesian Network Structure Learning from Massive Data Using MapReduce

被引：2
|
作者：
Li, Shun [1 ]
Wang, Biao [1 ]
机构：
[1] Univ Int Relat, Sch Informat Sci & Technol, Beijing 100091, Peoples R China
来源：
2017 IEEE 3RD INTERNATIONAL CONFERENCE ON BIG DATA SECURITY ON CLOUD (BIGDATASECURITY, IEEE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE AND SMART COMPUTING, (HPSC) AND 2ND IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA AND SECURITY (IDS) | 2017年
关键词：
Bayesian Network; Structure Learning; MapReduce; styling; Hybrid Learning; ALGORITHM; PARALLEL;
D O I：
10.1109/BigDataSecurity.2017.42
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Bayesian Network is the popular and important data mining model for representing uncertain knowledge. For large scale data it is often too costly to learn the accurate structure. To resolve this problem, much work has been done on migrating the structure learning algorithms to the MapReduce framework. In this paper, we introduce a distributed hybrid structure learning algorithm by combining the advantages of constraint-based and score-and-search-based algorithms. By reusing the intermediate results of MapReduce, the algorithm greatly simplified the computing work and got good results in both efficiency and accuracy.
引用
收藏
页码：272 / 276
页数：5
相关论文
共 50 条
  • [21] Hybrid algorithm for learning structure of Bayesian network from incomplete databases
    Saptawati, GAP
    Sitohang, B
    International Symposium on Communications and Information Technologies 2005, Vols 1 and 2, Proceedings, 2005, : 717 - 720
  • [22] Bayesian Network Structure Learning from Big Data: A Reservoir Sampling Based Ensemble Method
    Tang, Yan
    Xu, Zhuoming
    Zhuang, Yuanhang
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, DASFAA 2016, 2016, 9645 : 209 - 222
  • [23] Financial Data Modeling using a Hybrid Bayesian Network Structured Learning Algorithm
    Li, Shun
    Shi, Da
    Tan, Shaohua
    INTERNATIONAL JOURNAL OF COGNITIVE INFORMATICS AND NATURAL INTELLIGENCE, 2012, 6 (01) : 48 - 71
  • [24] A decomposition hybrid structure learning algorithm for Bayesian network using expert knowledge
    Huiping Guo
    Hongru Li
    Knowledge and Information Systems, 2023, 65 : 3023 - 3044
  • [25] A decomposition hybrid structure learning algorithm for Bayesian network using expert knowledge
    Guo, Huiping
    Li, Hongru
    KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 65 (07) : 3023 - 3044
  • [26] Hybrid Optimization Algorithm for Bayesian Network Structure Learning
    Sun, Xingping
    Chen, Chang
    Wang, Lu
    Kang, Hongwei
    Shen, Yong
    Chen, Qingyi
    INFORMATION, 2019, 10 (10)
  • [27] Causal inference and Bayesian network structure learning from nominal data
    Guiming Luo
    Boxu Zhao
    Shiyuan Du
    Applied Intelligence, 2019, 49 : 253 - 264
  • [28] Causal inference and Bayesian network structure learning from nominal data
    Luo, Guiming
    Zhao, Boxu
    Du, Shiyuan
    APPLIED INTELLIGENCE, 2019, 49 (01) : 253 - 264
  • [29] Identifiability and Consistency of Bayesian Network Structure Learning from Incomplete Data
    Bodewes, Tjebbe
    Scutari, Marco
    INTERNATIONAL CONFERENCE ON PROBABILISTIC GRAPHICAL MODELS, VOL 138, 2020, 138 : 29 - 40
  • [30] Towards MapReduce based Bayesian Deep Learning Network for Monitoring Big Data Applications
    Shafiq, M. Omair
    Torunski, Eric
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2112 - 2121
12345