Evolving Spiking Neural Networks for online learning over drifting data streams

被引:49
|
作者
Lobo, Jesus L. [1 ]
Lana, Ibai [1 ]
Del Ser, Javier [1 ,2 ,3 ]
Bilbao, Miren Nekane [2 ]
Kasabov, Nikola [4 ]
机构
[1] TECNALIA, Div ICT, Parque Tecnol Bizkaia, Derio 48160, Spain
[2] Univ Basque Country UPV EHU, Bilbao 48013, Spain
[3] BCAM, Bilbao 48009, Spain
[4] Auckland Univ Technol, KEDRI, Auckland 1010, New Zealand
关键词
Spiking Neural Networks; Data reduction; Online learning; Concept drift; SELF-GENERATING PROTOTYPES; PRINCIPLES;
D O I
10.1016/j.neunet.2018.07.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays huge volumes of data are produced in the form of fast streams, which are further affected by non-stationary phenomena. The resulting lack of stationarity in the distribution of the produced data calls for efficient and scalable algorithms for online analysis capable of adapting to such changes (concept drift). The online learning field has lately turned its focus on this challenging scenario, by designing incremental learning algorithms that avoid becoming obsolete after a concept drift occurs. Despite the noted activity in the literature, a need for new efficient and scalable algorithms that adapt to the drift still prevails as a research topic deserving further effort. Surprisingly, Spiking Neural Networks, one of the major exponents of the third generation of artificial neural networks, have not been thoroughly studied as an online learning approach, even though they are naturally suited to easily and quickly adapting to changing environments. This work covers this research gap by adapting Spiking Neural Networks to meet the processing requirements that online learning scenarios impose. In particular the work focuses on limiting the size of the neuron repository and making the most of this limited size by resorting to data reduction techniques. Experiments with synthetic and real data sets are discussed, leading to the empirically validated assertion that, by virtue of a tailored exploitation of the neuron repository, Spiking Neural Networks adapt better to drifts, obtaining higher accuracy scores than naive versions of Spiking Neural Networks for online learning environments. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 50 条
  • [1] Drift Detection over Non-stationary Data Streams Using Evolving Spiking Neural Networks
    Lobo, Jesus L.
    Del Ser, Javier
    Lana, Ibai
    Nekane Bilbao, Miren
    Kasabov, Nikola
    [J]. INTELLIGENT DISTRIBUTED COMPUTING XII, 2018, 798 : 82 - 94
  • [2] Online Active Learning for Drifting Data Streams
    Liu, Sanmin
    Xue, Shan
    Wu, Jia
    Zhou, Chuan
    Yang, Jian
    Li, Zhao
    Cao, Jie
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (01) : 186 - 200
  • [3] Unsupervised Anomaly Detection in Stream Data with Online Evolving Spiking Neural Networks
    Maciag, Piotr S.
    Kryszkiewicz, Marzena
    Bembenik, Robert
    Lobo, Jesus L.
    Del Ser, Javier
    [J]. NEURAL NETWORKS, 2021, 139 : 118 - 139
  • [4] Adaptive online incremental learning for evolving data streams
    Zhang, Si -si
    Liu, Jian-wei
    Zuo, Xin
    [J]. APPLIED SOFT COMPUTING, 2021, 105
  • [5] Online Evolving Spiking Neural Networks for Incremental Air Pollution Prediction
    Maciaq, Piotr S.
    Kryszkiewicz, Marzena
    Bembenik, Robert
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [6] Evolving Neural Networks for Online Reinforcement Learning
    Metzen, Jan Hendrik
    Edgington, Mark
    Kassahun, Yohannes
    Kirchner, Frank
    [J]. PARALLEL PROBLEM SOLVING FROM NATURE - PPSN X, PROCEEDINGS, 2008, 5199 : 518 - +
  • [7] Online Query by Committee for Active Learning from Drifting Data Streams
    Krawczyk, Bartosz
    Wozniak, Michal
    [J]. 2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2120 - 2127
  • [8] Spiking Neural Networks and online learning: An overview and perspectives
    Lobo, Jesus L.
    Del Ser, Javier
    Bifet, Albert
    Kasabov, Nikola
    [J]. NEURAL NETWORKS, 2020, 121 : 88 - 100
  • [9] Online ensemble learning with abstaining classifiers for drifting and noisy data streams
    Krawczyk, Bartosz
    Cano, Alberto
    [J]. APPLIED SOFT COMPUTING, 2018, 68 : 677 - 692
  • [10] Reinforcement Online Active Learning Ensemble for Drifting Imbalanced Data Streams
    Zhang, Hang
    Liu, Weike
    Liu, Qingbao
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (08) : 3971 - 3983