An ensemble method for concept drift in nonstationary environment

被引:16
|
作者
Mejri, Dhouha [1 ]
Khanchel, Riadh [2 ]
Limam, Mohamed [1 ]
机构
[1] Univ Tunis, Larodec, ISG Tunis, Tunis, Tunisia
[2] Univ Carthage, FSEG Nabeul, Larodec, Tunis, Tunisia
关键词
concept drift; ensemble method; data stream;
D O I
10.1080/00949655.2011.651797
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Most statistical and data-mining algorithms assume that data come from a stationary distribution. However, in many real-world classification tasks, data arrive over time and the target concept to be learned from the data stream may change accordingly. Many algorithms have been proposed for learning drifting concepts. To deal with the problem of learning when the distribution generating the data changes over time, dynamic weighted majority was proposed as an ensemble method for concept drift. Unfortunately, this technique considers neither the age of the classifiers in the ensemble nor their past correct classification. In this paper, we propose a method that takes into account expert's age as well as its contribution to the global algorithm's accuracy. We evaluate the effectiveness of our proposed method by using m classifiers and training a collection of n-fold partitioning of the data. Experimental results on a benchmark data set show that our method outperforms existing ones.
引用
收藏
页码:1115 / 1128
页数:14
相关论文
共 50 条
  • [41] Detection of Malicious Domains With Concept Drift Using Ensemble Learning
    Chiang, Pin-Hsuan
    Tsai, Shi-Chun
    IEEE Transactions on Network and Service Management, 2024, 21 (06): : 6796 - 6809
  • [42] Batch Weighted Ensemble for Mining Data Streams with Concept Drift
    Deckert, Magdalena
    FOUNDATIONS OF INTELLIGENT SYSTEMS, 2011, 6804 : 290 - 299
  • [43] Dynamical Targeted Ensemble Learning for Streaming Data With Concept Drift
    Guo, Husheng
    Zhang, Yang
    Wang, Wenjian
    IEEE Transactions on Knowledge and Data Engineering, 2024, 36 (12) : 8023 - 8036
  • [44] Sample Selection Method for Concept Drift
    Dai Jin
    Li Hao
    Wang Guoyin
    2023 8TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYTICS, ICCCBDA, 2023, : 402 - 406
  • [45] Diverse Instance-Weighting Ensemble Based on Region Drift Disagreement for Concept Drift Adaptation
    Liu, Anjin
    Lu, Jie
    Zhang, Guangquan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) : 293 - 307
  • [46] The Gradual Resampling Ensemble for mining imbalanced data streams with concept drift
    Ren, Siqi
    Liao, Bo
    Zhu, Wen
    Li, Zeng
    Liu, Wei
    Li, Keqin
    NEUROCOMPUTING, 2018, 286 : 150 - 166
  • [47] An Ensemble Based Incremental Learning Framework for Concept Drift and Class Imbalance
    Ditzler, Gregory
    Polikar, Robi
    2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010, 2010,
  • [48] Homogeneous-Heterogeneous Hybrid Ensemble for concept-drift adaptation
    Wilson, Jobin
    Chaudhury, Santanu
    Lall, Brejesh
    NEUROCOMPUTING, 2023, 557
  • [49] Streaming Data Classification Based on Hierarchical Concept Drift and Online Ensemble
    Liu, Ning
    Zhao, Jianhua
    IEEE ACCESS, 2023, 11 : 126040 - 126051
  • [50] Tracking recurrent concept drift in streaming data using ensemble classifiers
    Ramamurthy, Sasthakumar
    Bhatnagar, Raj
    ICMLA 2007: SIXTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, PROCEEDINGS, 2007, : 404 - 409