Paths sharing based FP-Growth data mining algorithms

被引:0
|
作者
Ji, Shandong [1 ]
Zhang, Dengyin [1 ]
Zhang, Liu [2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Nanjing, Jiangsu, Peoples R China
[2] China Telecom, Nanjing, Jiangsu, Peoples R China
关键词
MapReduce; FP-Growth improved algorithm; Frequent pattern mining;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the network alarm data in cloud environment has the characteristics of massive, redundancy, relevance, etc., traditional FP-Growth algorithm has memory and computing time double bottleneck. Therefore, this paper presents an improved FP-Growth algorithm, which based on sharing path. It scans the cube instead of multiple scans of the entire database, adopting structured storage of alarm data model, sharing same path to reduce recursive operations and using MapReduce framework for parallel computing. Experimental results show that the algorithm has high efficiency, good scalability and reliability. It can also identify the relationship of each device when alarm condition occurs, reduce duplication of alarms and provide basis for equipment maintenance and network management.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] The Research and Improvement Based on FP-Growth Data Mining Algorithm
    Yao, Quanzhu
    Gao, Xingxing
    Lei, Xueli
    Zhang, Tong
    [J]. PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON MODELING, SIMULATION AND OPTIMIZATION TECHNOLOGIES AND APPLICATIONS (MSOTA2016), 2016, 58 : 287 - 293
  • [2] A Novel Incremental Data Mining Algorithm based on FP-Growth for Big Data
    Chang, Hong-Yi
    Lin, Jia-Chi
    Cheng, Mei-Li
    Huang, Shih-Chang
    [J]. PROCEEDINGS 2016 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS NANA 2016, 2016, : 375 - 378
  • [3] Advanced Data Mining of SSD Quality Based on FP-Growth Data Analysis
    Chang, Jieh-Ren
    Chen, You-Shyang
    Lin, Chien-Ku
    Cheng, Ming-Fu
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (04): : 1 - 15
  • [4] FUZZY DATA MINING FOR QUANTITATIVE TRANSACTIONS WITH FP-GROWTH
    Wang, Chien-Hua
    Lee, Wei-Hsuan
    Pang, Chin-Tzong
    [J]. JOURNAL OF NONLINEAR AND CONVEX ANALYSIS, 2013, 14 (01) : 193 - 207
  • [5] An optimized fuzzy based FP-growth algorithm for mining temporal data
    Kumar, B. Praveen
    Padmavathy, T.
    Muthunagai, S. U.
    Paulraj, D.
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2024, 46 (01) : 41 - 51
  • [6] Parallelization of FP-growth Algorithm for Mining Probabilistic Numerical Data based on MapReduce
    Pei, Bin
    Wang, Xiuzhen
    Wang, Fenmei
    [J]. PROCEEDINGS OF 2016 9TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2016, : 223 - 226
  • [7] SQL based frequent pattern mining with FP-growth
    Shang, XQ
    Sattler, KU
    Geist, I
    [J]. APPLICATIONS OF DECLARATIVE PROGRAMMING AND KNOWLEDGE MANAGEMENT, 2005, 3392 : 32 - 46
  • [8] Pattern Mining on Stars with FP-Growth
    Silva, Andreia
    Antunes, Claudia
    [J]. MODELING DECISIONS FOR ARTIFICIAL INTELLIGENCE (MDAI), 2010, 6408 : 175 - 186
  • [9] MINING STARS WITH FP-GROWTH: A CASE STUDY ON BIBLIOGRAPHIC DATA
    Silva, Andreia
    Antunes, Claudia
    [J]. INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2011, 19 : 65 - 91
  • [10] Frequent Pattern Mining for Massive XBRL Data on Parallel FP-growth
    Feng, Tao
    Zeng, Zhi-Yong
    [J]. INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND COMMUNICATION ENGINEERING (CSCE 2015), 2015, : 1297 - 1305