Classification of Imbalanced Data Using Deep Learning with Adding Noise

被引:3
|
作者
Fan, Wan-Wei [1 ]
Lee, Ching-Hung [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Dept Elect & Comp Engn, Hsinchu, Taiwan
关键词
SURFACE DEFECT DETECTION;
D O I
10.1155/2021/1735386
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a method to treat the classification of imbalanced data by adding noise to the feature space of convolutional neural network (CNN) without changing a data set (ratio of majority and minority data). Besides, a hybrid loss function of crossentropy and KL divergence is proposed. The proposed approach can improve the accuracy of minority class in the testing data. In addition, a simple design method for selecting structure of CNN is first introduced and then, we add noise in feature space of CNN to obtain proper features by a training process and to improve the classification results. From comparison results, we can find that the proposed method can extract the suitable features to improve the accuracy of minority class. Finally, illustrated examples of multiclass classification problems and the corresponding discussion in balance ratio are presented. Our approach performs well with smaller network structure compared with other deep models. In addition, the performance is improved over 40% in defective accuracy by adding noise approach. Finally, the accuracy is higher than 96%; even the imbalanced ratio (IR) is one hundred.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Deep Learning for Imbalanced Multimedia Data Classification
    Yan, Yilin
    Chen, Min
    Shyu, Mei-Ling
    Chen, Shu-Ching
    2015 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2015, : 483 - 488
  • [2] Imbalanced Toxic Comments Classification using Data Augmentation and Deep Learning
    Ibrahim, Mai
    Torki, Marwan
    El-Makky, Nagwa
    2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, : 875 - 878
  • [3] Skin Lesion Classification on Imbalanced Data Using Deep Learning with Soft Attention
    Viet Dung Nguyen
    Ngoc Dung Bui
    Hoang Khoi Do
    SENSORS, 2022, 22 (19)
  • [4] Learning Deep Representation for Imbalanced Classification
    Huang, Chen
    Li, Yining
    Loy, Chen Change
    Tang, Xiaoou
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 5375 - 5384
  • [5] Deep reinforcement learning for imbalanced classification
    Lin, Enlu
    Chen, Qiong
    Qi, Xiaoming
    APPLIED INTELLIGENCE, 2020, 50 (08) : 2488 - 2502
  • [6] Learning Deep Landmarks for Imbalanced Classification
    Bao, Feng
    Deng, Yue
    Kong, Youyong
    Ren, Zhiquan
    Suo, Jinli
    Dai, Qionghai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (08) : 2691 - 2704
  • [7] Deep reinforcement learning for imbalanced classification
    Enlu Lin
    Qiong Chen
    Xiaoming Qi
    Applied Intelligence, 2020, 50 : 2488 - 2502
  • [8] HSDLM: A Hybrid Sampling With Deep Learning Method for Imbalanced Data Classification
    Hasib, Khan Md
    Towhid, Nurul Akter
    Islam, Md Rafiqul
    INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2021, 11 (04) : 1 - 13
  • [10] Hybrid Deep Learning Based Attack Detection for Imbalanced Data Classification
    Almarshdi, Rasha
    Nassef, Laila
    Fadel, Etimad
    Alowidi, Nahed
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 35 (01): : 297 - 320