A post-processing framework for class-imbalanced learning in a transductive setting

被引:0
|
作者
Jiang, Zhen [1 ]
Lu, Yu [1 ]
Zhao, Lingyun [1 ]
Zhan, Yongzhao [1 ]
Mao, Qirong [1 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Commun Engn, 301 Xuefu Rd, Zhenjiang 212013, Peoples R China
基金
中国国家自然科学基金;
关键词
Class-imbalanced learning; Post-processing; Class proportion; Compact prototype; ENSEMBLES; DATASETS; SVM;
D O I
10.1016/j.eswa.2024.123832
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional classification tasks suffer from the class-imbalanced problem, where some classes far outnumber others. To address this issue, existing class-imbalanced learning (CIL) methods either preprocess classimbalanced datasets or adapt traditional classification algorithms to the imbalanced class distribution. Inspired by the idea of transductive learning, we propose a post -processing framework called PPF for CIL. Distinct from existing CIL methods, PPF directly adjusts the predicted labels of test data to fit the imbalanced class distribution. Specifically, we relabel some test data according to their prediction probabilities so that the class proportion of test data is close to that of training data. The underlying assumption is that training and test data, drawn independently from one data space, should obey the same class distribution. Furthermore, we propose a Compact Prototype -based Nearest Neighbor (CPNN) algorithm to assist the original classifier with the adjustment. Instead of training a classifier, CPNN classifies test data according to their distances to a set of prototypes estimated on labeled data. Thus, it is computationally simple and relatively robust to class imbalance. As a general framework, PPF can be easily applied to both traditional classification and CIL algorithms. To validate the effectiveness of the proposed method, we conducted extensive experiments on a variety of classimbalanced datasets, using SVM and C4.5 as the original classifiers, respectively. Measured by F -measure, Gmean, and AUC, both PPF-SVM and PPF-C4.5 outperform 10 state-of-the-art CIL algorithms. Additionally, PPF further improved their performances when applied to 10 CIL algorithms.
引用
下载
收藏
页数:17
相关论文
共 50 条
  • [1] A Hybrid Framework for Class-Imbalanced Classification
    Chen, Rui
    Luo, Lailong
    Chen, Yingwen
    Xia, Junxu
    Guo, Deke
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT I, 2021, 12937 : 301 - 313
  • [2] Post-Processing Association Rules using Networks and Transductive Learning
    de Padua, Renan
    Rezende, Solange Oliveira
    de Carvalho, Veronica Oliveira
    2014 13TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2014, : 318 - 323
  • [3] Margin calibration in SVM class-imbalanced learning
    Yang, Chan-Yun
    Yang, Jr-Syu
    Wang, Jian-Jun
    NEUROCOMPUTING, 2009, 73 (1-3) : 397 - 411
  • [4] Prototypical Classifier for Robust Class-Imbalanced Learning
    Wei, Tong
    Shi, Jiang-Xin
    Li, Yu-Feng
    Zhang, Min-Ling
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT II, 2022, 13281 : 44 - 57
  • [5] Rethinking the Value of Labels for Improving Class-Imbalanced Learning
    Yang, Yuzhe
    Xu, Zhi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] A Weakly Supervised Learning-Based Oversampling Framework for Class-Imbalanced Fault Diagnosis
    Qian, Min
    Li, Yan-Fu
    IEEE TRANSACTIONS ON RELIABILITY, 2022, 71 (01) : 429 - 442
  • [7] A survey of class-imbalanced semi-supervised learning
    Gui, Qian
    Zhou, Hong
    Guo, Na
    Niu, Baoning
    MACHINE LEARNING, 2024, 113 (08) : 5057 - 5086
  • [8] Informative Nodes Mining for Class-Imbalanced Representation Learning
    Zhou, Mengting
    Gong, Zhiguo
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, : 1 - 11
  • [9] Learning Fairly With Class-Imbalanced Data for Interference Coordination
    Guo, Jia
    Xu, Zhaoqi
    Yang, Chenyang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (07) : 7176 - 7181
  • [10] Class-Imbalanced Deep Learning via a Class-Balanced Ensemble
    Chen, Zhi
    Duan, Jiang
    Kang, Li
    Qiu, Guoping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5626 - 5640