Learning under Concept Drift: A Review

被引:760
|
作者
Lu, Jie [1 ]
Liu, Anjin [1 ]
Dong, Fan [1 ]
Gu, Feng [1 ]
Gama, Joao [2 ]
Zhang, Guangquan [1 ]
机构
[1] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Artificial Intelligence, Decis Syst & E Serv Intelligence Lab, Sydney, NSW 2007, Australia
[2] Univ Porto, Fac Econ, Lab Artificial Intelligence & Decis Support, P-4099002 Porto, Portugal
基金
澳大利亚研究理事会;
关键词
Machine learning; Market research; Data analysis; Big Data; Mobile handsets; Data models; Cameras; Concept drift; change detection; adaptive learning; data streams; TIME ADAPTIVE CLASSIFIERS; TRACKING CONCEPT DRIFT; DATA STREAMS; DECISION TREES; ENSEMBLE; ONLINE; CLASSIFICATION; MACHINE; DIFFERENCE;
D O I
10.1109/TKDE.2018.2876857
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.
引用
收藏
页码:2346 / 2363
页数:18
相关论文
共 50 条
  • [1] Learning Under Concept Drift for Regression-A Systematic Literature Review
    Lima, Marilia
    Neto, Manoel
    Silva Filho, Telmo
    Fagundes, Roberta A. de A.
    IEEE ACCESS, 2022, 10 : 45410 - 45429
  • [2] Concept Drift Adaptation Methods under the Deep Learning Framework: A Literature Review
    Xiang, Qiuyan
    Zi, Lingling
    Cong, Xin
    Wang, Yan
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [3] Adaptive online learning for classification under concept drift
    Goel, Kanu
    Batra, Shalini
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2021, 24 (02) : 128 - 135
  • [4] Statistical Mechanics of On-Line Learning Under Concept Drift
    Straat, Michiel
    Abadi, Fthi
    Goepfert, Christina
    Hammer, Barbara
    Biehl, Michael
    ENTROPY, 2018, 20 (10)
  • [5] Learning under concept drift and non-stationary noise: Introduction of the concept of persistence
    Coskun, Kutalmis
    Tumer, Borahan
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [6] Learning Discrete-Time Markov Chains Under Concept Drift
    Roveri, Manuel
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (09) : 2570 - 2582
  • [7] Online Boosting Adaptive Learning under Concept Drift for Multistream Classification
    Yu, En
    Lu, Jie
    Zhang, Bin
    Zhang, Guangquan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 15, 2024, : 16522 - 16530
  • [8] LEARNING UNDER CONCEPT DRIFT USING A NEURO-EVOLUTIONARY ENSEMBLE
    Escovedo, Tatiana
    Abs Da Cruz, Andre V.
    Vellasco, Marley M. B. R.
    Koshiyama, Adriano S.
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS, 2013, 12 (04)
  • [9] An Augmented Learning Approach for Multiple Data Streams Under Concept Drift
    Wang, Kun
    Lu, Jie
    Liu, Anjin
    Zhang, Guangquan
    ADVANCES IN ARTIFICIAL INTELLIGENCE, AI 2023, PT I, 2024, 14471 : 391 - 402
  • [10] Concept Drift Evolution In Machine Learning Approaches: A Systematic Literature Review
    Hashmani, Manzoor Ahmed
    Jameel, Syed Muslim
    Rehman, Mobashar
    Inoue, Atsushi
    INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS, 2020, 13 (01): : 1 - 16