Online neural network model for non-stationary and imbalanced data stream classification

被引:62
|
作者
Ghazikhani, Adel [1 ]
Monsefi, Reza [1 ]
Yazdi, Hadi Sadoghi [1 ]
机构
[1] Ferdowsi Univ Mashhad, Dept Comp Engn, Mashhad, Iran
关键词
Data stream classification; Online learning; Neural Networks; Concept drift; Imbalanced data; FEATURE-SELECTION; ENVIRONMENTS; PREDICTION; ALGORITHM;
D O I
10.1007/s13042-013-0180-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
"Concept drift'' and class imbalance are two challenges for supervised classifiers. "Concept drift'' (or non-stationarity) is changes in the underlying function being learnt, and class imbalance is a vast difference between the numbers of instances in different classes of data. Class imbalance is an obstacle for the efficiency of most classifiers. Previous methods for classifying non-stationary and imbalanced data streams mainly focus on batch solutions, in which the classification model is trained using a chunk of data. Here, we propose an online Neural Network (NN) model. The NN model, is composed of two different parts for handling concept drift and class imbalance. Concept drift is handled with a forgetting function and class imbalance is handled with a specific error function which assigns different importance to error in separate classes. The proposed method is evaluated on 3 synthetic and 8 real world datasets. The results show statistically significant improvement to previous online NN methods.
引用
收藏
页码:51 / 62
页数:12
相关论文
共 50 条
  • [21] QUEUES WITH NON-STATIONARY INPUT STREAM
    ROLSKI, T
    STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1987, 26 (02) : 185 - 185
  • [22] A Fast Adaptive Classification Approach Using Kernel Ridge Regression and Clustering for Non-stationary Data Stream
    Gautam, Chandan
    Bansal, Raman
    Garg, Ruchir
    Agarwalla, Vedaanta
    Tiwari, Aruna
    MACHINE INTELLIGENCE AND SIGNAL ANALYSIS, 2019, 748 : 739 - 751
  • [23] Non-stationary data mining: The network security issue
    Decherchi, Sergio
    Gastaldo, Paolo
    Redi, Judith
    Zunino, Rodolfo
    ARTIFICIAL NEURAL NETWORKS - ICANN 2008, PT II, 2008, 5164 : 32 - 41
  • [24] Dynamic supervised classification method for online monitoring in non-stationary environments
    Hartert, Laurent
    Sayed-Mouchaweh, Moamar
    NEUROCOMPUTING, 2014, 126 : 118 - 131
  • [25] Modular neural network applied to non-stationary time series
    Allende, H
    Salas, R
    Torres, R
    Moraga, C
    Computational Intelligence, Theory and Applications, 2005, : 585 - 598
  • [26] An online ensemble classification algorithm for multi-class imbalanced data stream
    Han, Meng
    Li, Chunpeng
    Meng, Fanxing
    He, Feifei
    Zhang, Ruihua
    KNOWLEDGE AND INFORMATION SYSTEMS, 2024, 66 (11) : 6845 - 6880
  • [27] Non-stationary deep network for restoration of non-Stationary lens blur
    Kim, Soowoong
    Gwak, Moonsung
    Yang, Seungjoon
    PATTERN RECOGNITION LETTERS, 2018, 108 : 62 - 69
  • [28] Online prediction of non-stationary chaotic time series with noise based on combinational NARX neural network
    Ge, Jiahao
    Xiang, Jinwu
    Li, Daochun
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2024, 45 (21):
  • [29] Affect Detection and Classification from the Non-Stationary Physiological Data
    AlZoubi, Omar
    Fossati, Davide
    D'Mello, Sidney
    2013 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2013), VOL 1, 2013, : 240 - 245
  • [30] Neural Network With a Preference Sampling Paradigm for Imbalanced Data Classification
    Huang, Zhan Ao
    Sang, Yongsheng
    Sun, Yanan
    Lv, Jiancheng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) : 9252 - 9266