UnderBagging based reduced Kernelized weighted extreme learning machine for class imbalance learning

被引:38
|
作者
Raghuwanshi, Bhagat Singh [1 ]
Shukla, Sanyam [1 ]
机构
[1] MANIT, Dept Comp Sci & Engn, Bhopal 462003, Madhya Pradesh, India
关键词
Kernelized extreme learning machine; Class imbalance problem; Classification; UnderBagging ensemble; Voting methods; SUPPORT VECTOR MACHINES; CLASSIFICATION; ALGORITHMS; REGRESSION;
D O I
10.1016/j.engappai.2018.07.002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extreme learning machine (ELM) is one of the foremost capable, quick genuine esteemed classification algorithm with good generalization performance. Conventional ELM does not take into account the class imbalance problem effectively. Numerous variants of ELM-like weighted ELM (WELM), Boosting WELM (BWELM) etc. have been proposed in order to diminish the performance degradation which happens due to the class imbalance problem. This work proposed a novel Reduced Kernelized WELM (RKWELM) which is a variant of kernelized WELM to handle the class imbalance problem more effectively. The performance of RKWELM varies due to the arbitrary selection of the kernel centroids. To reduce this variation, this work uses ensemble method. The computational complexity of kernelized ELM (KELM) is subject to the number of kernels. KELM generally employ Gaussian kernel function. It employs all of the training instances to act as the centroid. This will lead to computation of the pseudoinverse of N x N matrix. Here, N represents the number of training instances. This operation becomes very slow for the large values of N. Moreover, for the imbalanced classification problems, using all the training instances as the centroid will result in more number of centroids representing the majority class compared to the centroids representing the minority class. This might lead to biased classification model, which favors the majority class instances. So, this work uses a subset of the training instances as the centroid of the kernels. RKWELM arbitrarily chooses N-min instances from each class which acts as the centroid. The total number of centroids will be (N) over tilde = m x N-min. Here, m represents the number of classes and N-min is the number of instances belonging to the minority class which has the least number of instances. This reduction in the number of kernels will lead to reduced kernel matrix of size, (N) over tilde x (N) over tilde leading to decrease in the computational complexity. This work creates a number of balanced kernel subsets depending on the degree of class imbalance. A number of RKWELM based classification models are produced utilizing these balanced kernel subsets. The ultimate outcome is computed by the majority voting and the soft voting of these classification models. The proposed algorithm is assessed by using the benchmark real-world imbalanced datasets downloaded from the KEEL dataset repository. The experimental results indicate the superiority of the proposed work in contrast with the rest of classifiers for the imbalanced classification problems.
引用
收藏
页码:252 / 270
页数:19
相关论文
共 50 条
  • [31] A reduced universum twin support vector machine for class imbalance learning
    Richhariya, B.
    Tanveer, M.
    [J]. PATTERN RECOGNITION, 2020, 102 (102)
  • [32] Online Extreme Learning Machine for Handling Concept Drift and Class Imbalance Problem
    Vinayagasundaram, B.
    Aarthi, R. J.
    Abirami, N.
    [J]. 2017 FOURTH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATION AND NETWORKING (ICSCN), 2017,
  • [33] WEIGHTED EXTREME LEARNING MACHINE FOR BALANCE AND OPTIMIZATION LEARNING
    Ban, Xiaojuan
    Liu, Ruoyi
    Shen, Qing
    Wang, Yu
    [J]. PROCEEDINGS OF 2016 4TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (IEEE CCIS 2016), 2016, : 6 - 10
  • [34] Deep Weighted Extreme Learning Machine
    Tianlei Wang
    Jiuwen Cao
    Xiaoping Lai
    Badong Chen
    [J]. Cognitive Computation, 2018, 10 : 890 - 907
  • [35] Deep Weighted Extreme Learning Machine
    Wang, Tianlei
    Cao, Jiuwen
    Lai, Xiaoping
    Chen, Badong
    [J]. COGNITIVE COMPUTATION, 2018, 10 (06) : 890 - 907
  • [36] A Comparative Study of One-Class Classifiers in Machine Learning Problems with Extreme Class Imbalance
    Sotiropoulos, Dionysios
    Giannoulis, Christos
    Tsihrintzis, George A.
    [J]. 5TH INTERNATIONAL CONFERENCE ON INFORMATION, INTELLIGENCE, SYSTEMS AND APPLICATIONS, IISA 2014, 2014, : 362 - 364
  • [37] Class-specific extreme learning machine based on overall distribution for addressing binary imbalance problem
    Bhagat Singh Raghuwanshi
    [J]. Soft Computing, 2023, 27 : 4609 - 4626
  • [38] Classifying imbalanced data using BalanceCascade-based kernelized extreme learning machine
    Raghuwanshi, Bhagat Singh
    Shukla, Sanyam
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2020, 23 (03) : 1157 - 1182
  • [39] Class-specific extreme learning machine based on overall distribution for addressing binary imbalance problem
    Raghuwanshi, Bhagat Singh
    [J]. SOFT COMPUTING, 2023, 27 (08) : 4609 - 4626
  • [40] Classifying imbalanced data using BalanceCascade-based kernelized extreme learning machine
    Bhagat Singh Raghuwanshi
    Sanyam Shukla
    [J]. Pattern Analysis and Applications, 2020, 23 : 1157 - 1182