A novel dimension reduction and dictionary learning framework for high-dimensional data classification

被引:22
|
作者
Li, Yanxia [2 ]
Chai, Yi [1 ,2 ]
Zhou, Han [2 ]
Yin, Hongpeng [1 ,2 ]
机构
[1] State Key Lab Power Transmiss Equipment & Syst Se, Chongqing, Peoples R China
[2] Chongqing Univ, Coll Automat, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
High-dimensional data classification; Dimension reduction; Dictionary learning; Autoencoder; COLLABORATIVE REPRESENTATION; DISCRIMINATIVE DICTIONARY; K-SVD; SPARSE; PROJECTION; AUTOENCODERS;
D O I
10.1016/j.patcog.2020.107793
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-dimensional problem poses significant challenges for dictionary learning based classification architecture. Joint Dimension Reduction and Dictionary Learning (JDRDL) framework shows great potential for overcoming the challenges caused by high dimensionality. However, most of the existing JDRDL approaches do not consider the complex nonlinear relationships within high-dimensional data, which limits their classification performance. To overcome this problem, a novel joint dimension reduction and dictionary learning framework is proposed in this paper for high-dimensional data classification. Firstly, at dimension reduction stage, an autoencoder is employed to learn a nonlinear mapping that reduces dimensionality and preserves nonlinear structure of the high-dimensional data. Then, at dictionary learning stage, the locality constraint with label embedding, which takes the locality and label information into account together, is incorporated into the learning process to preserve desirable nonlinear local structure and enhance class discrimination. Moreover, the mapping function and dictionary are optimized simultaneously to enhance the performance. Encouraging experimental results on multiple benchmark datasets confirm that the proposed framework is effective and efficient for high-dimensional data classification. (c) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Fast Dictionary Learning for High-Dimensional Seismic Reconstruction
    Wang, Hang
    Chen, Wei
    Zhang, Quan
    Liu, Xingye
    Zu, Shaohuan
    Chen, Yangkang
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (08): : 7098 - 7108
  • [32] Dimension reduction and data sharpening of high-dimensional vegetation data: An application to Swiss mire monitoring
    Ghosh, Sucharita
    Graf, Ulrich
    Ecker, Klaus
    Wildi, Otto
    Kuechler, Helen
    Feldmeyer-Christe, Elizabeth
    Kuechler, Meinrad
    [J]. ECOLOGICAL INDICATORS, 2014, 36 : 242 - 253
  • [33] Observable Dictionary Learning for High-Dimensional Statistical Inference
    Mathelin, Lionel
    Kasper, Kevin
    Abou-Kandil, Hisham
    [J]. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2018, 25 (01) : 103 - 120
  • [34] Distributed dictionary learning for high-dimensional process monitoring
    Huang, Keke
    Wu, Yiming
    Wen, Haofei
    Liu, Yishun
    Yang, Chunhua
    Gui, Weihua
    [J]. CONTROL ENGINEERING PRACTICE, 2020, 98
  • [35] XDL: An Industrial Deep Learning Framework for High-dimensional Sparse Data
    Jiang, Biye
    Deng, Chao
    Yi, Huimin
    Hu, Zelin
    Zhou, Guorui
    Zheng, Yang
    Huang, Sui
    Guo, Xinyang
    Wang, Dongyue
    Song, Yue
    Zhao, Liqin
    Wang, Zhi
    Sun, Peng
    Zhang, Yu
    Zhang, Di
    Li, Jinhui
    Xu, Jian
    Zhu, Xiaoqiang
    Gai, Kun
    [J]. 1ST INTERNATIONAL WORKSHOP ON DEEP LEARNING PRACTICE FOR HIGH-DIMENSIONAL SPARSE DATA WITH KDD (DLP-KDD 2019), 2019,
  • [36] A Manifold Learning Framework for Reducing High-dimensional Big Text Data
    Salem, Rashed
    [J]. 2017 12TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND SYSTEMS (ICCES), 2017, : 347 - 352
  • [37] High-dimensional Data Stream Classification via Sparse Online Learning
    Wang, Dayong
    Wu, Pengcheng
    Zhao, Peilin
    Wu, Yue
    Miao, Chunyan
    Hoi, Steven C. H.
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2014, : 1007 - 1012
  • [38] PERFORMANCE OF MACHINE LEARNING METHODS IN CLASSIFICATION MODELS WITH HIGH-DIMENSIONAL DATA
    Zekic-Susac, Marijana
    Pfeifer, Sanja
    Sarlija, Natasa
    [J]. SOR'13 PROCEEDINGS: THE 12TH INTERNATIONAL SYMPOSIUM ON OPERATIONAL RESEARCH IN SLOVENIA, 2013, : 219 - 224
  • [39] A Novel Angle-Based Learning Framework on Semi-supervised Dimensionality Reduction in High-Dimensional Data with Application to Action Recognition
    Zahra Ramezani
    Ahmad Pourdarvish
    Kiumars Teymourian
    [J]. Arabian Journal for Science and Engineering, 2020, 45 : 11051 - 11063
  • [40] A Novel Angle-Based Learning Framework on Semi-supervised Dimensionality Reduction in High-Dimensional Data with Application to Action Recognition
    Ramezani, Zahra
    Pourdarvish, Ahmad
    Teymourian, Kiumars
    [J]. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2020, 45 (12) : 11051 - 11063