SPPC: a new tree structure for mining erasable patterns in data streams

被引:18
|
作者
Le, Tuong [1 ]
Vo, Bay [2 ,3 ]
Fournier-Viger, Philippe [4 ]
Lee, Mi Young [1 ]
Baik, Sung Wook [1 ]
机构
[1] Sejong Univ, Digital Contents Res Inst, Seoul, South Korea
[2] Ton Duc Thang Univ, Div Data Sci, Ho Chi Minh City, Vietnam
[3] Ton Duc Thang Univ, Fac Informat Technol, Ho Chi Minh City, Vietnam
[4] Harbin Inst Technol Shenzhen, Sch Nat Sci & Humanities, Shenzhen, GD, Peoples R China
关键词
Data mining; Data streams; Erasable patterns; Sliding window; WINDOW BASED ALGORITHM; SLIDING WINDOW; FREQUENT ITEMSETS; EFFICIENT ALGORITHMS; ASSOCIATION RULES; UTILITY PATTERNS;
D O I
10.1007/s10489-018-1280-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Discovering Erasable Patterns (EPs) consists of identifying product parts that will produce a small profit loss if their production is stopped. It is a data mining problem that has attracted the attention of numerous researchers in recent years due to the possibility of using EPs to reduce profit loss of manufacturers. Though, many algorithms have been designed to mine EPs, an important limitation of state-of-the-art EP mining algorithms is that they are batch algorithms, that is, they are designed to be applied on static databases. But in real-life applications, databases are dynamic, as they are constantly updated by adding or removing products and parts. To be informed about EPs in real-time, traditional EP mining algorithms must be applied over and over again on a database. This is inefficient as those algorithms are always applied from scratch without taking advantage of results generated by previous executions. Considering this important drawback of previous work for handling real-life dynamic data, this paper proposes an efficient algorithm named MSPPC for mining EPs in data streams. It relies on a novel tree structure named SPPC (Streaming Pre-Post Code) tree, which extends the WPPC tree structure for maintaining a compact tree representation of EPs in a data stream. Experimental results show that the designed MSPPC algorithm outperforms the state-of-the-art batch MERIT and dMERIT algorithms when they are run in batch mode using a sliding-window. Besides, the proposed algorithm is also faster than the state-of-the-art algorithms for mining EPs, namely MERIT, dMERIT + , MEI and EIFDD.
引用
收藏
页码:478 / 495
页数:18
相关论文
共 50 条
  • [21] Interactive mining of high utility patterns over data streams
    Ahmed, Chowdhury Farhan
    Tanbeer, Syed Khairuzzaman
    Jeong, Byeong-Soo
    Choi, Ho-Jin
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (15) : 11979 - 11991
  • [22] WSFI-Mine: Mining Frequent Patterns in Data Streams
    Kim, Younghee
    Kim, Ungmo
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2009, PT 2, PROCEEDINGS, 2009, 5552 : 845 - 852
  • [23] Dynamically, mining frequent patterns over online data streams
    Liu, XJ
    Xu, HB
    Dong, YS
    Wang, YL
    Qian, JB
    [J]. PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, 2005, 3758 : 645 - 654
  • [24] SPEDS: A Framework for Mining Sequential Patterns in Evolving Data Streams
    Soliman, Amany F.
    Ebrahim, Gamal A.
    Mohammed, Hoda K.
    [J]. 2011 IEEE PACIFIC RIM CONFERENCE ON COMMUNICATIONS, COMPUTERS AND SIGNAL PROCESSING (PACRIM), 2011, : 464 - 469
  • [25] Efficient Mining of Weighted Frequent Patterns Over Data Streams
    Ahmed, Chowdhury Farhan
    Tanbeer, Syed Khairuzzaman
    Jeong, Byeong-Soo
    [J]. HPCC: 2009 11TH IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2009, : 400 - 406
  • [26] Mining Rare Sequential Patterns in Data Streams with a Sliding Window
    Ouyang, Weimin
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2016, : 1023 - 1027
  • [27] Incrementally Mining Recently Repeating Patterns over Data Streams
    Koh, Jia-Ling
    Chou, Pei-Min
    [J]. NEW FRONTIERS IN APPLIED DATA MINING, 2009, 5433 : 26 - 37
  • [28] Mining frequent closed patterns with item constraints in data streams
    Hu, Wei-Cheng
    Wang, Ben-Nian
    Cheng, Zhuan-Liu
    [J]. PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2008, : 274 - 280
  • [29] Mining sequential patterns from data streams: a centroid approach
    Alice Marascu
    Florent Masseglia
    [J]. Journal of Intelligent Information Systems, 2006, 27 : 291 - 307
  • [30] Mining Weighted Frequent Patterns from Uncertain Data Streams
    Ovi, Jesan Ahammed
    Ahmed, Chowdhury Farhan
    Leung, Carson K.
    Pazdor, Adam G. M.
    [J]. PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM) 2019, 2019, 935 : 917 - 936