Neuroevolutionary learning in nonstationary environments

被引:4
|
作者
Escovedo, Tatiana [1 ]
Koshiyama, Adriano [2 ]
da Cruz, Andre Abs [3 ]
Vellasco, Marley [1 ]
机构
[1] Pontificia Univ Catolica Rio de Janeiro, Dept Elect Engn, R Marques de Sao Vicente 225, BR-22430060 Rio de Janeiro, Brazil
[2] UCL, Dept Comp Sci, London, England
[3] MDC Partners, Antwerp, Belgium
关键词
Concept drift; Adaptive learning; Nonstationary environments; Neuroevolutionary ensemble; Quantum-inspired evolution; RULE-BASED CLASSIFIERS; CONCEPT DRIFT; ENSEMBLE; ONLINE;
D O I
10.1007/s10489-019-01591-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents a new neuro-evolutionary model, called NEVE (Neuroevolutionary Ensemble), based on an ensemble of Multi-Layer Perceptron (MLP) neural networks for learning in nonstationary environments. NEVE makes use of quantum-inspired evolutionary models to automatically configure the ensemble members and combine their output. The quantum-inspired evolutionary models identify the most appropriate topology for each MLP network, select the most relevant input variables, determine the neural network weights and calculate the voting weight of each ensemble member. Four different approaches of NEVE are developed, varying the mechanism for detecting and treating concepts drifts, including proactive drift detection approaches. The proposed models were evaluated in real and artificial datasets, comparing the results obtained with other consolidated models in the literature. The results show that the accuracy of NEVE is higher in most cases and the best configurations are obtained using some mechanism for drift detection. These results reinforce that the neuroevolutionary ensemble approach is a robust choice for situations in which the datasets are subject to sudden changes in behaviour.
引用
收藏
页码:1590 / 1608
页数:19
相关论文
共 50 条
  • [1] Neuroevolutionary learning in nonstationary environments
    Tatiana Escovedo
    Adriano Koshiyama
    Andre Abs da Cruz
    Marley Vellasco
    [J]. Applied Intelligence, 2020, 50 : 1590 - 1608
  • [2] Learning in Nonstationary Environments: A Survey
    Ditzler, Gregory
    Roveri, Manuel
    Alippi, Cesare
    Polikar, Robi
    [J]. IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2015, 10 (04) : 12 - 25
  • [3] Active Learning in Nonstationary Environments
    Capo, Robert
    Dyer, Karl B.
    Polikar, Robi
    [J]. 2013 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2013,
  • [4] Learning in Nonstationary and Evolving Environments
    Polikar, Robi
    Alippi, Cesare
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (01) : 9 - 11
  • [5] ROBUST NEUROEVOLUTIONARY IDENTIFICATION OF NONLINEAR NONSTATIONARY OBJECTS
    Rudenko, O. G.
    Bersonov, O. O.
    [J]. CYBERNETICS AND SYSTEMS ANALYSIS, 2014, 50 (01) : 17 - 30
  • [6] Learning in Nonstationary Environments: A Hybrid Approach
    Alippi, Cesare
    Qi, Wen
    Roveri, Manuel
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2017, PT II, 2017, 10246 : 703 - 714
  • [7] Transductive Learning Algorithms for Nonstationary Environments
    Ditzler, Gregory
    Rosen, Gail
    Polikar, Robi
    [J]. 2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
  • [8] Adaptation to nonstationary environments - Learning and evolution
    Cristea, P
    [J]. IWALT 2000: INTERNATIONAL WORKSHOP ON ADVANCED LEARNING TECHNOLOGIES: ADVANCED LEARNING TECHNOLOGY: DESIGN AND DEVELOPMENT ISSUES, 2000, : 265 - 267
  • [9] Limitations of Simultaneous Multiagent Learning in Nonstationary Environments
    Noda, Itsuki
    [J]. 2013 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON INTELLIGENT AGENT TECHNOLOGY (IAT 2013), 2013, : 309 - 314
  • [10] Semi-supervised Learning in Nonstationary Environments
    Ditzler, Gregory
    Polikar, Robi
    [J]. 2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 2741 - 2748