Sparse nonlinear dimension reduction algorithm

被引:0
|
作者
Xu, Daoxuan [1 ]
机构
[1] Beijing Technol & Business Univ, Beijing 102488, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA) | 2022年
关键词
manifold learning; nearest neighbor; sparse; dimension reduction;
D O I
10.1109/EEBDA53927.2022.9744987
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
After we go into the big data age, the scale of data sets becomes more and more massive. The dimension of the data is also higher. For a task, there are a huge number of features in the ultra-high-dimensional data set that are irrelevant to the learning task. Manifold learning is proposed to reduce the dimensions of high-dimensional data sets and to use a manifold and other geometric tools to extract features from the data sets to obtain valid features and eliminate invalid features. However, the traditional manifold learning algorithms still have some unresolved problems by themselves. At present, the classic manifold learning algorithm can not deal with some large scale data sets. The main reason is that the cost of memory is very high during the algorithm construction. Therefore, this article makes some improvement for the basic manifold algorithm and proposes a sparse algorithm to reduce the memory cost and the time complexity. In experiments, we are using three sets of combinational data sets for comparative experiments. The experimental results show that the improved algorithm has obvious advantages in terms of time consumption.
引用
收藏
页码:967 / 971
页数:5
相关论文
共 50 条
  • [1] Sparse sufficient dimension reduction
    Li, Lexin
    BIOMETRIKA, 2007, 94 (03) : 603 - 613
  • [2] Study on Orthogonal Tensor Sparse Neighborhood Preserving Embedding Algorithm for Dimension Reduction
    Qi, Mingming
    Zhang, Yanqiu
    Lv, Dongdong
    Yuan, Shuhan
    Lu, Hai
    Xi, Xin
    PROCEEDINGS OF 2014 IEEE WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS (WARTIA), 2014, : 1392 - 1396
  • [3] A Sparse Dimension-Reduction based Person Re-Identification Algorithm
    Wang, Hongyuan
    Zhang, Wenwen
    Sun, Jinyu
    Geng, Lei
    Wang, Chong
    Wan, Jianwu
    Chen, Fuhua
    REAL-TIME IMAGE AND VIDEO PROCESSING 2018, 2018, 10670
  • [4] Sparse dimension reduction for survival data
    Changrong Yan
    Dixin Zhang
    Computational Statistics, 2013, 28 : 1835 - 1852
  • [5] Sparse kernel sufficient dimension reduction
    Liu, Bingyuan
    Xue, Lingzhou
    JOURNAL OF NONPARAMETRIC STATISTICS, 2024,
  • [6] Sparse dimension reduction for survival data
    Yan, Changrong
    Zhang, Dixin
    COMPUTATIONAL STATISTICS, 2013, 28 (04) : 1835 - 1852
  • [7] Sparse sufficient dimension reduction with heteroscedasticity
    Cheng, Haoyang
    Cui, Wenquan
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2022, 20 (01)
  • [8] Double Shrinking Sparse Dimension Reduction
    Zhou, Tianyi
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (01) : 244 - 257
  • [9] Sparse dimension reduction with group identification
    Alkenani, Ali
    INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2022, 13 (01): : 2921 - 2931
  • [10] Efficient Sparse Estimate of Sufficient Dimension Reduction in High Dimension
    Chen, Xin
    Sheng, Wenhui
    Yin, Xiangrong
    TECHNOMETRICS, 2018, 60 (02) : 161 - 168