Classification of Imbalanced Data Using Deep Learning with Adding Noise

被引:3
|
作者
Fan, Wan-Wei [1 ]
Lee, Ching-Hung [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Dept Elect & Comp Engn, Hsinchu, Taiwan
关键词
SURFACE DEFECT DETECTION;
D O I
10.1155/2021/1735386
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a method to treat the classification of imbalanced data by adding noise to the feature space of convolutional neural network (CNN) without changing a data set (ratio of majority and minority data). Besides, a hybrid loss function of crossentropy and KL divergence is proposed. The proposed approach can improve the accuracy of minority class in the testing data. In addition, a simple design method for selecting structure of CNN is first introduced and then, we add noise in feature space of CNN to obtain proper features by a training process and to improve the classification results. From comparison results, we can find that the proposed method can extract the suitable features to improve the accuracy of minority class. Finally, illustrated examples of multiclass classification problems and the corresponding discussion in balance ratio are presented. Our approach performs well with smaller network structure compared with other deep models. In addition, the performance is improved over 40% in defective accuracy by adding noise approach. Finally, the accuracy is higher than 96%; even the imbalanced ratio (IR) is one hundred.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] Fuzzy Neighbors and Deep Learning-Assisted Spark Model for Imbalanced Classification of Big Data
    Nalinipriya, G.
    Geetha, M.
    Sudha, D.
    Daniya, T.
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2023, 31 (01) : 141 - 162
  • [42] Deep Spatio-Temporal Representation Learning for Multi-Class Imbalanced Data Classification
    Pouyanfar, Samira
    Chen, Shu-Ching
    Shyu, Mei-Ling
    2018 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI), 2018, : 386 - 393
  • [43] Synthesizing Data Using Variational Autoencoders for Handling Class Imbalanced Deep Learning
    Sheikh, Taimoor Shakeel
    Khan, Adil
    Fahim, Muhammad
    Ahmad, Muhammad
    ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS (AIST 2019), 2020, 1086 : 270 - 281
  • [44] Improving Deep Learning Performance Using Sampling Techniques for IoT Imbalanced Data
    El Hariri, Ayyoub
    Mouiti, Mohamed
    Habibi, Omar
    Lazaar, Mohamed
    18TH INTERNATIONAL CONFERENCE ON FUTURE NETWORKS AND COMMUNICATIONS, FNC 2023/20TH INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS AND PERVASIVE COMPUTING, MOBISPC 2023/13TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY, SEIT 2023, 2023, 224 : 180 - 187
  • [45] Imbalanced Data Classification Method Based on Ensemble Learning
    Xiang, Yu
    Xie, Yongping
    COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL III: SYSTEMS, 2020, 517 : 18 - 24
  • [46] Classification of Imbalanced Data Using SMOTE and AutoEncoder Based Deep Convolutional Neural Network
    Alex, Suja A.
    Nayahi, J. Jesu Vedha
    INTERNATIONAL JOURNAL OF UNCERTAINTY FUZZINESS AND KNOWLEDGE-BASED SYSTEMS, 2023, 31 (03) : 437 - 469
  • [47] Multiset Feature Learning for Highly Imbalanced Data Classification
    Jing, Xiao-Yuan
    Zhang, Xinyu
    Zhu, Xiaoke
    Wu, Fei
    You, Xinge
    Gao, Yang
    Shan, Shiguang
    Yang, Jing-Yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 139 - 156
  • [48] Multiset Feature Learning for Highly Imbalanced Data Classification
    Wu, Fei
    Jing, Xiao-Yuan
    Shan, Shiguang
    Zuo, Wangmeng
    Yang, Jing-Yu
    THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1583 - 1589
  • [49] An Improved Extreme Learning Machine for Imbalanced Data Classification
    Zhang, Xiaopeng
    Qin, Liangxi
    IEEE ACCESS, 2022, 10 : 8634 - 8642
  • [50] URBAN CLASSIFICATION USING POLSAR DATA AND DEEP LEARNING
    De, Shaunak
    Bhattacharya, Avik
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 353 - 356