Towards Effective Classification of Imbalanced Data with Convolutional Neural Networks

被引:33
|
作者
Raj, Vidwath [1 ]
Magg, Sven [1 ]
Wermter, Stefan [1 ]
机构
[1] Univ Hamburg, Dept Informat, Knowledge Technol, Hamburg, Germany
关键词
D O I
10.1007/978-3-319-46182-3_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Class imbalance in machine learning is a problem often found with real-world data, where data from one class clearly dominates the dataset. Most neural network classifiers fail to learn to classify such datasets correctly if class-to-class separability is poor due to a strong bias towards the majority class. In this paper we present an algorithmic solution, integrating different methods into a novel approach using a class-to-class separability score, to increase performance on poorly separable, imbalanced datasets using Cost Sensitive Neural Networks. We compare different cost functions and methods that can be used for training Convolutional Neural Networks on a highly imbalanced dataset of multi-channel time series data. Results show that, despite being imbalanced and poorly separable, performance metrics such as G-Mean as high as 92.8% could be reached by using cost sensitive Convolutional Neural Networks to detect patterns and correctly classify time series from 3 different datasets.
引用
收藏
页码:150 / 162
页数:13
相关论文
共 50 条
  • [21] ADANOISE: Training neural networks with adaptive noise for imbalanced data classification
    Shin, Kyoham
    Kang, Seokho
    [J]. Expert Systems with Applications, 2022, 192
  • [22] Sewer damage detection from imbalanced CCTV inspection data using deep convolutional neural networks with hierarchical classification
    Li, Duanshun
    Cong, Anran
    Guo, Shuai
    [J]. AUTOMATION IN CONSTRUCTION, 2019, 101 : 199 - 208
  • [23] Classification of Imbalanced Data Using SMOTE and AutoEncoder Based Deep Convolutional Neural Network
    Alex, Suja A.
    Nayahi, J. Jesu Vedha
    [J]. INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2023, 31 (03) : 437 - 469
  • [24] Cost sensitive convolutional neural network: a classification method for imbalanced data of mechanical fault
    Dong, Xun
    Guo, Liang
    Gao, Hongli
    Liu, Chenyu
    Li, Lei
    [J]. Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2019, 40 (12): : 205 - 213
  • [25] Towards Automated Optimization of Residual Convolutional Neural Networks for Electrocardiogram Classification
    Fki, Zeineb
    Ammar, Boudour
    Ayed, Mounir Ben
    [J]. COGNITIVE COMPUTATION, 2024, 16 (03) : 1334 - 1344
  • [26] Hyperspectral Data Classification using Deep Convolutional Neural Networks
    Salman, Mesut
    Yuksel, Seniha Esen
    [J]. 2016 24TH SIGNAL PROCESSING AND COMMUNICATION APPLICATION CONFERENCE (SIU), 2016, : 2129 - 2132
  • [27] Data Driven Regularization for Convolutional Neural Networks on Image Classification
    Chen, Yihao
    Wang, Hanli
    Li, Qinyu
    Huang, Deshuang
    [J]. 2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
  • [28] Convolutional Neural Networks for Multimodal Remote Sensing Data Classification
    Wu, Xin
    Hong, Danfeng
    Chanussot, Jocelyn
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [29] PLANKTON CLASSIFICATION ON IMBALANCED LARGE SCALE DATABASE VIA CONVOLUTIONAL NEURAL NETWORKS WITH TRANSFER LEARNING
    Lee, Hansang
    Park, Minseok
    Kim, Junmo
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3713 - 3717
  • [30] IMBALANCED MULTICLASS TRAFFIC SIGN IMAGES CLASSIFICATION BASED ON MINORITY OVERSAMPLING AND CONVOLUTIONAL NEURAL NETWORKS
    Sani, Idi Boubacar
    Zakari, Ibrahim Sidi
    Idrissa, Moctar Mossi
    [J]. ADVANCES AND APPLICATIONS IN STATISTICS, 2022, 83 : 121 - 132