UnderBagging based reduced Kernelized weighted extreme learning machine for class imbalance learning

被引:38
|
作者
Raghuwanshi, Bhagat Singh [1 ]
Shukla, Sanyam [1 ]
机构
[1] MANIT, Dept Comp Sci & Engn, Bhopal 462003, Madhya Pradesh, India
关键词
Kernelized extreme learning machine; Class imbalance problem; Classification; UnderBagging ensemble; Voting methods; SUPPORT VECTOR MACHINES; CLASSIFICATION; ALGORITHMS; REGRESSION;
D O I
10.1016/j.engappai.2018.07.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extreme learning machine (ELM) is one of the foremost capable, quick genuine esteemed classification algorithm with good generalization performance. Conventional ELM does not take into account the class imbalance problem effectively. Numerous variants of ELM-like weighted ELM (WELM), Boosting WELM (BWELM) etc. have been proposed in order to diminish the performance degradation which happens due to the class imbalance problem. This work proposed a novel Reduced Kernelized WELM (RKWELM) which is a variant of kernelized WELM to handle the class imbalance problem more effectively. The performance of RKWELM varies due to the arbitrary selection of the kernel centroids. To reduce this variation, this work uses ensemble method. The computational complexity of kernelized ELM (KELM) is subject to the number of kernels. KELM generally employ Gaussian kernel function. It employs all of the training instances to act as the centroid. This will lead to computation of the pseudoinverse of N x N matrix. Here, N represents the number of training instances. This operation becomes very slow for the large values of N. Moreover, for the imbalanced classification problems, using all the training instances as the centroid will result in more number of centroids representing the majority class compared to the centroids representing the minority class. This might lead to biased classification model, which favors the majority class instances. So, this work uses a subset of the training instances as the centroid of the kernels. RKWELM arbitrarily chooses N-min instances from each class which acts as the centroid. The total number of centroids will be (N) over tilde = m x N-min. Here, m represents the number of classes and N-min is the number of instances belonging to the minority class which has the least number of instances. This reduction in the number of kernels will lead to reduced kernel matrix of size, (N) over tilde x (N) over tilde leading to decrease in the computational complexity. This work creates a number of balanced kernel subsets depending on the degree of class imbalance. A number of RKWELM based classification models are produced utilizing these balanced kernel subsets. The ultimate outcome is computed by the majority voting and the soft voting of these classification models. The proposed algorithm is assessed by using the benchmark real-world imbalanced datasets downloaded from the KEEL dataset repository. The experimental results indicate the superiority of the proposed work in contrast with the rest of classifiers for the imbalanced classification problems.
引用
收藏
页码:252 / 270
页数:19
相关论文
共 50 条
  • [1] Class imbalance learning using UnderBagging based kernelized extreme learning machine
    Raghuwanshi, Bhagat Singh
    Shukla, Sanyam
    [J]. NEUROCOMPUTING, 2019, 329 : 172 - 187
  • [2] A clustering based ensemble of weighted kernelized extreme learning machine for class imbalance learning
    Choudhary, Roshani
    Shukla, Sanyam
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 164
  • [3] Class-specific kernelized extreme learning machine for binary class imbalance learning
    Raghuwanshi, Bhagat Singh
    Shukla, Sanyam
    [J]. APPLIED SOFT COMPUTING, 2018, 73 : 1026 - 1038
  • [4] Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning
    Mirza, Bilal
    Lin, Zhiping
    Toh, Kar-Ann
    [J]. NEURAL PROCESSING LETTERS, 2013, 38 (03) : 465 - 486
  • [5] Weighted Online Sequential Extreme Learning Machine for Class Imbalance Learning
    Bilal Mirza
    Zhiping Lin
    Kar-Ann Toh
    [J]. Neural Processing Letters, 2013, 38 : 465 - 486
  • [6] Weighted extreme learning machine for imbalance learning
    Zong, Weiwei
    Huang, Guang-Bin
    Chen, Yiqiang
    [J]. NEUROCOMPUTING, 2013, 101 : 229 - 242
  • [7] Universum based kernelized weighted extreme learning machine for imbalanced datasets
    Bhagat Singh Raghuwanshi
    Akansha Mangal
    Sanyam Shukla
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 3387 - 3408
  • [8] Universum based kernelized weighted extreme learning machine for imbalanced datasets
    Raghuwanshi, Bhagat Singh
    Mangal, Akansha
    Shukla, Sanyam
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (11) : 3387 - 3408
  • [9] Classifying imbalanced data using ensemble of reduced kernelized weighted extreme learning machine
    Raghuwanshi, Bhagat Singh
    Shukla, Sanyam
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (11) : 3071 - 3097
  • [10] Classifying imbalanced data using ensemble of reduced kernelized weighted extreme learning machine
    Bhagat Singh Raghuwanshi
    Sanyam Shukla
    [J]. International Journal of Machine Learning and Cybernetics, 2019, 10 : 3071 - 3097