A dual encoder DAE neural network for imbalanced binary classification based on NSGA-III and GAN

被引:4
|
作者
Qu, Jiantao [1 ,2 ,3 ]
Liu, Feng [1 ,2 ]
Ma, Yuxiang [3 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Minist Educ, Engn Res Ctr Network Management Technol High Spee, Beijing 100044, Peoples R China
[3] Henan Univ, Sch Comp & Informat Engn, Kaifeng 475004, Peoples R China
关键词
Imbalanced data; GAN; NSGA-III; Denoising auto-encoder; Deep learning; PREDICTION; SMOTE;
D O I
10.1007/s10044-021-01035-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In real-world datasets, the number of samples in each class is often imbalanced, which results in the classifier's suboptimal performance. Presently, the imbalanced binary classification approach based on deep learning has achieved good results and gets more attention constantly. In this study, we present a dual encoder (Denoising Auto-Encoder) DAE neural network based on non-dominated sorting genetic algorithm (NSGA-III) and generative adversarial network (GAN) to address the imbalanced binary classification problem. The primary aim of our approach is to increase the separability between the reconstruction error of minority class latent features and the reconstruction error of majority class latent features. For this purpose, we first create a dual encoder DAE network to obtain the reconstruction error of latent features of training data. Second, when training the neural network, we introduced GAN to perform a layer-wise training which can improve the training effect of the model. Third, in order to increase the separability of the reconstruction error of minority class and majority class, we utilize NSGA-III to optimize the parameters of the second encoder. Then, we can obtain a set of non-dominated solutions. Finally, based on the Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method, we can get the best solution, which is the most appropriate parameter set of the second encoder to distinguish the minority class and the majority class. The experiment results on both benchmark datasets and a real-world dataset for communication anomaly detection demonstrate the superiority of the proposed approach in imbalanced binary classification problem.
引用
收藏
页码:17 / 34
页数:18
相关论文
共 50 条
  • [1] A dual encoder DAE neural network for imbalanced binary classification based on NSGA-III and GAN
    Jiantao Qu
    Feng Liu
    Yuxiang Ma
    Pattern Analysis and Applications, 2022, 25 : 17 - 34
  • [2] The optimization of reactive power for distribution network with PV generation based on NSGA-III
    Ai Y.
    Du M.
    Pan Z.
    Li G.
    CPSS Transactions on Power Electronics and Applications, 2021, 6 (03): : 193 - 200
  • [3] A Dual-Population-Based NSGA-III for Constrained Many-Objective Optimization
    Geng, Huantong
    Zhou, Zhengli
    Shen, Junye
    Song, Feifei
    ENTROPY, 2023, 25 (01)
  • [4] Self-adaptive network structure tuning method based on NSGA-III
    Du, Lei
    Cui, Zhihua
    INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND MATHEMATICS, 2021, 13 (01) : 54 - 63
  • [5] An Imbalanced Data Classification Algorithm of De-noising Auto-Encoder Neural Network Based on SMOTE
    Zhang, Chenggang
    Song, Jiazhi
    Pei, Zhili
    Jiang, Jingqing
    2016 8TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2016), 2016, 56
  • [6] Multi-Objective Optimization of Deep-Sea Mining Pump Based on CFD, GABP Neural Network and NSGA-III Algorithm
    Hu, Qiong
    Zhai, Xiaoyu
    Li, Zhenfu
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (08)
  • [7] An intelligent optimization method for the HCSB blanket based on an improved multi-objective NSGA-III algorithm and an adaptive BP neural network
    Zhou, Wen
    Sun, Guomin
    Miwa, Shuichiro
    Yang, Zihui
    Li, Zhuang
    Zhang, Di
    Wang, Jianye
    NUCLEAR ENGINEERING AND TECHNOLOGY, 2023, 55 (09) : 3150 - 3163
  • [8] TA-GAN: GAN based Traffic Augmentation for Imbalanced Network Traffic Classification
    Guo, Yu
    Xiong, Gang
    Li, Zhen
    Shi, Junzheng
    Cui, Mingxin
    Gou, Gaopeng
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [9] Heterophily-Based Graph Neural Network for Imbalanced Classification
    Liang, Zirui
    Li, Yuntao
    Huang, Tianjin
    Saxena, Akrati
    Pei, Yulong
    Pechenizkiy, Mykola
    COMPLEX NETWORKS & THEIR APPLICATIONS XII, VOL 1, COMPLEX NETWORKS 2023, 2024, 1141 : 74 - 86
  • [10] Core design optimization of small modular dual fluid reactor based on NSGA-III in the aspect of reactor physics
    Chen, Runkai
    Seidl, Marcus
    Wang, Xiang
    ANNALS OF NUCLEAR ENERGY, 2022, 174