A two-stage deep learning model based on feature combination effects

被引:2
|
作者
Teng, Xuyang [1 ]
Zhang, Yunxiao [1 ]
He, Meilin [1 ]
Han, Meng [2 ]
Liu, Erxiao [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Zhejiang Univ, Data Intelligence Res Ctr, Binjiang Inst, Hangzhou 310053, Zhejiang, Peoples R China
关键词
Deep learning; Feature selection; Correlation information entropy; Combination effect; STACKED DENOISING AUTOENCODERS; FEATURE-SELECTION; MUTUAL INFORMATION; NETWORK; ALGORITHM; CLASSIFICATION; RELEVANCE;
D O I
10.1016/j.neucom.2022.09.082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning currently provides the best solutions in various industries involving tremendous data, such as object recognition and intrusion detection. In deep learning models, the quality and volume of data are two of the factors that determine task performance. This study concentrates on utilizing high-quality data to simultaneously improve the efficiency and accuracy of deep networks. This paper proposes a two-stage learning model that aims to generate high-quality data with reduced features during the first stage. Then, the selected data subset is regarded as the input in the second stage, i.e., the deep learning stage. However, most existing feature selection methods neglect the combination effect induced by inte-grated feature subsets. A correlation information entropy-based approach is developed to evaluate the integrated non-linear subspace. Experiments are carried out on six well-known classification datasets. The results indicate that our proposed two-stage learning model performs better than the compared high-dimensional deep learning models in speeding up the learning process and improving classification accuracy. Moreover, our developed feature selection method outperforms state-of-the-art feature selec-tion techniques in terms of time consumption and classification accuracy when combined with three deep learning models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:307 / 322
页数:16
相关论文
共 50 条
  • [1] TDCF: A two-stage deep learning based recommendation model
    Wang, Ruiqin
    Cheng, Hsing Kenneth
    Jiang, Yunliang
    Lou, Jungang
    [J]. Wang, Ruiqin (wrq@zjhu.edu.cn), 1600, Elsevier Ltd (145):
  • [2] An Integrated Recommendation Model Based on Two-stage Deep Learning
    Wang, Ruiqin
    Wu, Zongda
    Jiang, Yunliang
    Lou, Jungang
    [J]. Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (08): : 1661 - 1669
  • [3] Scene Classification Based on Two-Stage Deep Feature Fusion
    Liu, Yishu
    Liu, Yingbin
    Ding, Liwang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (02) : 183 - 186
  • [4] Deep Model Compression via Two-Stage Deep Reinforcement Learning
    Zhan, Huixin
    Lin, Wei-Ming
    Cao, Yongcan
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 238 - 254
  • [5] A novel deep learning ensemble model based on two-stage feature selection and intelligent optimization for water quality prediction
    Liu, Wenli
    Liu, Tianxiang
    Liu, Zihan
    Luo, Hanbin
    Pei, Hanmin
    [J]. ENVIRONMENTAL RESEARCH, 2023, 224
  • [6] A Novel Group Recommendation Model With Two-Stage Deep Learning
    Huang, Zhenhua
    Liu, Yajun
    Zhan, Choujun
    Lin, Chen
    Cai, Weiwei
    Chen, Yunwen
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (09): : 5853 - 5864
  • [7] Two-Stage Deep Learning Model for Automated Segmentation and Classification of Splenomegaly
    Meddeb, Aymen
    Kossen, Tabea
    Bressem, Keno K.
    Molinski, Noah
    Hamm, Bernd
    Nagel, Sebastian N.
    [J]. CANCERS, 2022, 14 (22)
  • [8] DTDeMo: A Deep Learning-Based Two-Stage Image Demosaicing Model With Interpolation and Enhancement
    Hou, Jingchao
    Gendy, Garas
    Chen, Guo
    Wang, Liangchao
    He, Guanghui
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1026 - 1039
  • [9] A two-stage recognition method based on deep learning for sheep behavior
    Gu, Zishuo
    Zhang, Haoyu
    He, Zhiqiang
    Niu, Kai
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 212
  • [10] A two-stage seismic data denoising network based on deep learning
    Zhang, Yan
    Zhang, Chi
    Song, Liwei
    [J]. STUDIA GEOPHYSICA ET GEODAETICA, 2024,