Learning Convolutional Neural Networks in presence of Concept Drift

被引:18
|
作者
Disabato, Simone [1 ]
Roveri, Manuel [1 ]
机构
[1] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, Milan, Italy
关键词
D O I
10.1109/ijcnn.2019.8851731
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Designing adaptive machine learning systems able to operate in nonstationary conditions, also called concept drift, is a novel and promising research area. Convolutional Neural Networks (CNNs) have not been considered a viable solution for such adaptive systems due to the high computational load and the high number of images they require for the training. This paper introduces an adaptive mechanism for learning CNNs able to operate in presence of concept drift. Such an adaptive mechanism follows an "active approach", where the adaptation is triggered by the detection of a concept drift, and relies on the "transfer learning" paradigm to transfer (part of the) knowledge from the CNN operating before the concept drift to the one operating after. The effectiveness of the proposed solution has been evaluated on two types of CNNs and two real-world image benchmarks.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Comprehensible Convolutional Neural Networks via Guided Concept Learning
    Wickramanayake, Sandareka
    Hsu, Wynne
    Lee, Mong Li
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [2] Adaptive Federated Learning in Presence of Concept Drift
    Canonaco, Giuseppe
    Bergamasco, Alex
    Mongelluzzo, Alessi
    Roveri, Manuel
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [3] Learning in the presence of class imbalance and concept drift
    Wang, Shuo
    Minku, Leandro L.
    Chawla, Nitesh
    Yao, Xin
    NEUROCOMPUTING, 2019, 343 : 1 - 2
  • [4] Learning in the presence of concept drift and hidden contexts
    Widmer, G
    Kubat, M
    MACHINE LEARNING, 1996, 23 (01) : 69 - 101
  • [5] Supervised learning in the presence of concept drift: a modelling framework
    Straat, M.
    Abadi, F.
    Kan, Z.
    Goepfert, C.
    Hammer, B.
    Biehl, M.
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (01): : 101 - 118
  • [6] Supervised learning in the presence of concept drift: a modelling framework
    M. Straat
    F. Abadi
    Z. Kan
    C. Göpfert
    B. Hammer
    M. Biehl
    Neural Computing and Applications, 2022, 34 : 101 - 118
  • [7] Learning Convolutional Neural Networks for Graphs
    Niepert, Mathias
    Ahmed, Mohamed
    Kutzkov, Konstantin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [8] INCREMENTAL LEARNING OF CONVOLUTIONAL NEURAL NETWORKS
    Medera, Dusan
    Babinec, Stefan
    IJCCI 2009: PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL INTELLIGENCE, 2009, : 547 - +
  • [9] The Impact of Diversity on Online Ensemble Learning in the Presence of Concept Drift
    Minku, Leandro L.
    White, Allan P.
    Yao, Xin
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (05) : 730 - 742
  • [10] Learning to Prune Filters in Convolutional Neural Networks
    Huang, Qiangui
    Zhou, Kevin
    You, Suya
    Neumann, Ulrich
    2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 709 - 718