Learning under Concept Drift: A Review

被引:760
|
作者
Lu, Jie [1 ]
Liu, Anjin [1 ]
Dong, Fan [1 ]
Gu, Feng [1 ]
Gama, Joao [2 ]
Zhang, Guangquan [1 ]
机构
[1] Univ Technol Sydney, Fac Engn & Informat Technol, Ctr Artificial Intelligence, Decis Syst & E Serv Intelligence Lab, Sydney, NSW 2007, Australia
[2] Univ Porto, Fac Econ, Lab Artificial Intelligence & Decis Support, P-4099002 Porto, Portugal
基金
澳大利亚研究理事会;
关键词
Machine learning; Market research; Data analysis; Big Data; Mobile handsets; Data models; Cameras; Concept drift; change detection; adaptive learning; data streams; TIME ADAPTIVE CLASSIFIERS; TRACKING CONCEPT DRIFT; DATA STREAMS; DECISION TREES; ENSEMBLE; ONLINE; CLASSIFICATION; MACHINE; DIFFERENCE;
D O I
10.1109/TKDE.2018.2876857
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding, and adaptation. Data analysis has revealed that machine learning in a concept drift environment will result in poor learning results if the drift is not addressed. To help researchers identify which research topics are significant and how to apply related techniques in data analysis tasks, it is necessary that a high quality, instructive review of current research developments and trends in the concept drift field is conducted. In addition, due to the rapid development of concept drift in recent years, the methodologies of learning under concept drift have become noticeably systematic, unveiling a framework which has not been mentioned in literature. This paper reviews over 130 high quality publications in concept drift related research areas, analyzes up-to-date developments in methodologies and techniques, and establishes a framework of learning under concept drift including three main components: concept drift detection, concept drift understanding, and concept drift adaptation. This paper lists and discusses 10 popular synthetic datasets and 14 publicly available benchmark datasets used for evaluating the performance of learning algorithms aiming at handling concept drift. Also, concept drift related research directions are covered and discussed. By providing state-of-the-art knowledge, this survey will directly support researchers in their understanding of research developments in the field of learning under concept drift.
引用
收藏
页码:2346 / 2363
页数:18
相关论文
共 50 条
  • [21] Tiny Machine Learning for Concept Drift
    Disabato, Simone
    Roveri, Manuel
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 8470 - 8481
  • [22] An Ensemble Learning Approach for Concept Drift
    Liao, Jian-Wei
    Dai, Bi-Ru
    2014 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND APPLICATIONS (ICISA), 2014,
  • [23] DriftSurf: Stable-State / Reactive-State Learning under Concept Drift
    Tahmasbi, Ashraf
    Jothimurugesan, Ellango
    Tirthapura, Srikanta
    Gibbons, Phillip B.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139 : 7057 - 7066
  • [24] Forgetful Forests: Data Structures for Machine Learning on Streaming Data under Concept Drift
    Yuan, Zhehu
    Sun, Yinqi
    Shasha, Dennis
    ALGORITHMS, 2023, 16 (06)
  • [25] A Critical Review on Adverse Effects of Concept Drift over Machine Learning Classification Models
    Jameel, Syed Muslim
    Hashmani, Manzoor Ahmed
    Alhussain, Hitham
    Rehman, Mobashar
    Budiman, Arif
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (01) : 206 - 211
  • [26] A META-LEARNING METHOD FOR CONCEPT DRIFT
    Wang, Runxin
    Shi, Lei
    Foghlu, Micheal O.
    Robson, Eric
    KDIR 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL, 2010, : 257 - 262
  • [27] Learning in the presence of class imbalance and concept drift
    Wang, Shuo
    Minku, Leandro L.
    Chawla, Nitesh
    Yao, Xin
    NEUROCOMPUTING, 2019, 343 : 1 - 2
  • [28] Adaptive Federated Learning in Presence of Concept Drift
    Canonaco, Giuseppe
    Bergamasco, Alex
    Mongelluzzo, Alessi
    Roveri, Manuel
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [29] Incremental Learning of Variable Rate Concept Drift
    Elwell, Ryan
    Polikar, Robi
    MULTIPLE CLASSIFIER SYSTEMS, PROCEEDINGS, 2009, 5519 : 142 - 151
  • [30] An Impact Study of Concept Drift in Federated Learning
    Yang, Guanhui
    Chen, Xiaoting
    Zhang, Tengsen
    Wang, Shuo
    Yang, Yun
    23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING, ICDM 2023, 2023, : 1457 - 1462