A dual encoder DAE neural network for imbalanced binary classification based on NSGA-III and GAN

被引:4
|
作者
Qu, Jiantao [1 ,2 ,3 ]
Liu, Feng [1 ,2 ]
Ma, Yuxiang [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Minist Educ, Engn Res Ctr Network Management Technol High Spee, Beijing 100044, Peoples R China
[3] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475004, Peoples R China
关键词
Imbalanced data; GAN; NSGA-III; Denoising auto-encoder; Deep learning; PREDICTION; SMOTE;
D O I
10.1007/s10044-021-01035-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world datasets, the number of samples in each class is often imbalanced, which results in the classifier's suboptimal performance. Presently, the imbalanced binary classification approach based on deep learning has achieved good results and gets more attention constantly. In this study, we present a dual encoder (Denoising Auto-Encoder) DAE neural network based on non-dominated sorting genetic algorithm (NSGA-III) and generative adversarial network (GAN) to address the imbalanced binary classification problem. The primary aim of our approach is to increase the separability between the reconstruction error of minority class latent features and the reconstruction error of majority class latent features. For this purpose, we first create a dual encoder DAE network to obtain the reconstruction error of latent features of training data. Second, when training the neural network, we introduced GAN to perform a layer-wise training which can improve the training effect of the model. Third, in order to increase the separability of the reconstruction error of minority class and majority class, we utilize NSGA-III to optimize the parameters of the second encoder. Then, we can obtain a set of non-dominated solutions. Finally, based on the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method, we can get the best solution, which is the most appropriate parameter set of the second encoder to distinguish the minority class and the majority class. The experiment results on both benchmark datasets and a real-world dataset for communication anomaly detection demonstrate the superiority of the proposed approach in imbalanced binary classification problem.
引用
收藏
页码:17 / 34
页数:18
相关论文
共 50 条
  • [31] Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem
    Zhang, Min
    Wang, Jie-Sheng
    Liu, Yu
    Song, Hao-Ming
    Hou, Jia-Ning
    Wang, Yu-Cai
    Wang, Min
    INFORMATION SCIENCES, 2023, 648
  • [32] Vehicle Classification Algorithm based on Binary Proximity Magnetic Sensors and Neural Network
    Zhang, Wei
    Tan, Guozhen
    Ding, Nan
    Shang, Yao
    Lin, Mingwen
    PROCEEDINGS OF THE 11TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2008, : 145 - 150
  • [33] Binary Classification Quantum Neural Network Model Based on Optimized Grover Algorithm
    Zhao, Wenlin
    Wang, Yinuo
    Qu, Yingjie
    Ma, Hongyang
    Wang, Shumei
    ENTROPY, 2022, 24 (12)
  • [34] A multi-objective optimal collaborative gas flow regulation method for non-stationary ventilation network based on improved NSGA-III algorithm
    Wang, Kai
    Ai, Zibo
    Zhou, Aitao
    Fu, Qiang
    Zhao, Wei
    ADVANCED ENGINEERING INFORMATICS, 2024, 61
  • [35] Attack Classification of Imbalanced Intrusion Data for IoT Network Using Ensemble-Learning-Based Deep Neural Network
    Thakkar, Ankit
    Lohiya, Ritika
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (13) : 11888 - 11895
  • [36] A graph neural network-based node classification model on class-imbalanced graph data
    Huang, Zhenhua
    Tang, Yinhao
    Chen, Yunwen
    KNOWLEDGE-BASED SYSTEMS, 2022, 244
  • [37] A sparse auto-encoder-based deep neural network approach for induction motor faults classification
    Sun, Wenjun
    Shao, Siyu
    Zhao, Rui
    Yan, Ruqiang
    Zhang, Xingwu
    Chen, Xuefeng
    MEASUREMENT, 2016, 89 : 171 - 178
  • [38] Classification method of power quality disturbances based on deep neural network of sparse auto-encoder
    Qu X.
    Duan B.
    Yin Q.
    Yan Y.
    Zhong Y.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2019, 39 (05): : 157 - 162
  • [39] A Binary Approximate Naive Bayesian Classification Algorithm Based on SOM Neural Network Clustering
    Shen Honghong
    He Lili
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 1344 - 1347
  • [40] Classification of ERP Signals from Mild Cognitive Impairment Patients with Diabetes using Dual Input Encoder Convolutional Neural Network
    Wen, Dong
    Wei, Zhenhao
    Zhou, Yanhong
    Bian, Zhijie
    Yin, Shimin
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND VIRTUAL ENVIRONMENTS FOR MEASUREMENT SYSTEMS AND APPLICATIONS (CIVEMSA 2019), 2019, : 156 - 159