Fast concept drift detection using unlabeled data

被引:0
|
作者
Shang, Dan [1 ]
Zhang, Guangquan [1 ]
Lu, Jie [1 ]
机构
[1] Univ Technol Sydney, Ctr Artificial Intelligence, Fac Engn & Informat Technol, Sydney, NSW 2007, Australia
基金
澳大利亚研究理事会;
关键词
Concept Drift; Unsupervised Learning; Stream Data Mining;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Streaming data mining is in use today in many industrial applications, but performance of the models is deteriorated by concept drift, especially when true labels are unavailable. This paper addresses the need of detecting concept drifts under unsupervised situation and proposes the Unsupervised Concept Drift Detection (UCDD) method. A cluster technique is first applied to determine artificial labels of the data set, then a fast drift detection algorithm is used to detect the boundary change between the labeled clusters. Through the empirical evaluation, the method demonstrates effectiveness on detecting various types of concept drifts.
引用
收藏
页码:133 / 140
页数:8
相关论文
共 50 条
  • [1] On the reliable detection of concept drift from streaming unlabeled data
    Sethi, Tegjyot Singh
    Kantardzic, Mehmed
    EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 : 77 - 99
  • [2] Handling Concept Drift in Data Streams by Using Drift Detection Methods
    Patil, Malini M.
    DATA MANAGEMENT, ANALYTICS AND INNOVATION, ICDMAI 2018, VOL 2, 2019, 839 : 155 - 166
  • [3] Fast Concept Drift Detection Using Singular Vector Decomposition
    Shang, Dan
    Zhang, Guangquan
    Lu, Jie
    2017 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND KNOWLEDGE ENGINEERING (IEEE ISKE), 2017,
  • [4] Concept Drift Detection for Streaming Data
    Wang, Heng
    Abraham, Zubin
    2015 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2015,
  • [5] Intrusion detection in the IoT data streams using concept drift localization
    Chu, Renjie
    Jin, Peiyuan
    Qiao, Hanli
    Feng, Quanxi
    AIMS MATHEMATICS, 2024, 9 (01): : 1535 - 1561
  • [6] Concept Drift Detection for Evolving Stream Data
    Lee, Jeonghoon
    Lee, Yoon-Joon
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (11) : 2288 - 2292
  • [7] Concept Drift Detection in Streams of Labelled Data Using the Restricted Boltzmann Machine
    Jaworski, Maciej
    Duda, Piotr
    Rutkowski, Leszek
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [8] A novel concept drift detection method in data streams using ensemble classifiers
    Dehghan, Mahdie
    Beigy, Hamid
    ZareMoodi, Poorya
    INTELLIGENT DATA ANALYSIS, 2016, 20 (06) : 1329 - 1350
  • [9] A Precise Statistical approach for concept change detection in unlabeled data streams
    Mozafari, Niloofar
    Hashemi, Sattar
    Hamzeh, Ali
    COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2011, 62 (04) : 1655 - 1669
  • [10] Concept based text classification using labeled and unlabeled data
    Gu, Ping
    Zhu, Qingsheng
    He, Xiping
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2006, 4093 : 652 - 660