Unsupervised Adaptive Embedding for Dimensionality Reduction

被引:13
|
作者
Wang, Jingyu [1 ,2 ]
Xie, Fangyuan [1 ]
Nie, Feiping [2 ]
Li, Xuelong [2 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Intelligent Interact & Applicat, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Kernel; Clustering algorithms; Manifolds; Learning systems; Principal component analysis; Dimensionality reduction; Optimization; Adaptive neighbors; graph embedding; linear dimensionality reduction (DR); unsupervised; FRAMEWORK; FACE;
D O I
10.1109/TNNLS.2021.3083695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-dimensional data are highly correlative and redundant, making it difficult to explore and analyze. Amount of unsupervised dimensionality reduction (DR) methods has been proposed, in which constructing a neighborhood graph is the primary step of DR methods. However, there exist two problems: 1) the construction of graph is usually separate from the selection of projection direction and 2) the original data are inevitably noisy. In this article, we propose an unsupervised adaptive embedding (UAE) method for DR to solve these challenges, which is a linear graph-embedding method. First, an adaptive allocation method of neighbors is proposed to construct the affinity graph. Second, the construction of affinity graph and calculation of projection matrix are integrated together. It considers the local relationship between samples and global characteristic of high-dimensional data, in which the cleaned data matrix is originally proposed to remove noise in subspace. The relationship between our method and local preserving projections (LPPs) is also explored. Finally, an alternative iteration optimization algorithm is derived to solve our model, the convergence and computational complexity of which are also analyzed. Comprehensive experiments on synthetic and benchmark datasets illustrate the superiority of our method.
引用
收藏
页码:6844 / 6855
页数:12
相关论文
共 50 条
  • [1] Neighborhood Balance Embedding for Unsupervised Dimensionality Reduction
    Sun, Mingming
    Liu, Chuancai
    Yang, Jingyu
    [J]. PROCEEDINGS OF THE 2009 CHINESE CONFERENCE ON PATTERN RECOGNITION AND THE FIRST CJK JOINT WORKSHOP ON PATTERN RECOGNITION, VOLS 1 AND 2, 2009, : 123 - 126
  • [2] Distance Penalization Embedding for Unsupervised Dimensionality Reduction
    Sun, Mingming
    Jin, Zhong
    Yang, Jian
    Yang, Jingyu
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 371 - 376
  • [3] Flexible and Adaptive Unsupervised Dimensionality Reduction
    Qiang Q.-Y.
    Zhang B.
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (11): : 2290 - 2305
  • [4] Adaptive Flexible Optimal Graph for Unsupervised Dimensionality Reduction
    Chen, Hong
    Nie, Feiping
    Wang, Rong
    Li, Xuelong
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 2162 - 2166
  • [5] Discriminative unsupervised 2D dimensionality reduction with graph embedding
    Guo, Jun
    Zhao, Xiaowei
    Yuan, Xuan
    Li, Yangyuan
    Peng, Yao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (03) : 3189 - 3207
  • [6] Discriminative unsupervised 2D dimensionality reduction with graph embedding
    Jun Guo
    Xiaowei Zhao
    Xuan Yuan
    Yangyuan Li
    Yao Peng
    [J]. Multimedia Tools and Applications, 2018, 77 : 3189 - 3207
  • [7] Locality preserving projection with symmetric graph embedding for unsupervised dimensionality reduction
    Lu, Xiaohuan
    Long, Jiang
    Wen, Jie
    Fei, Lunke
    Zhang, Bob
    Xu, Yong
    [J]. PATTERN RECOGNITION, 2022, 131
  • [8] Fast and Robust Unsupervised Dimensionality Reduction with Adaptive Bipartite Graphs
    Niu, Fan
    Zhao, Xiaowei
    Guo, Jun
    Shi, Mei
    Liu, Xiaoxia
    Liu, Baoying
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 276
  • [9] Sparse robust adaptive unsupervised subspace learning for dimensionality reduction
    Xiong, Weizhi
    Yu, Guolin
    Ma, Jun
    Liu, Sheng
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [10] Dimensionality reduction by t-Distribution adaptive manifold embedding
    Wang, Changpeng
    Feng, Linlin
    Yang, Lijuan
    Wu, Tianjun
    Zhang, Jiangshe
    [J]. APPLIED INTELLIGENCE, 2023, 53 (20) : 23853 - 23863