Unsupervised Adaptive Embedding for Dimensionality Reduction

被引:13
|
作者
Wang, Jingyu [1 ,2 ]
Xie, Fangyuan [1 ]
Nie, Feiping [2 ]
Li, Xuelong [2 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Intelligent Interact & Applicat, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Kernel; Clustering algorithms; Manifolds; Learning systems; Principal component analysis; Dimensionality reduction; Optimization; Adaptive neighbors; graph embedding; linear dimensionality reduction (DR); unsupervised; FRAMEWORK; FACE;
D O I
10.1109/TNNLS.2021.3083695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-dimensional data are highly correlative and redundant, making it difficult to explore and analyze. Amount of unsupervised dimensionality reduction (DR) methods has been proposed, in which constructing a neighborhood graph is the primary step of DR methods. However, there exist two problems: 1) the construction of graph is usually separate from the selection of projection direction and 2) the original data are inevitably noisy. In this article, we propose an unsupervised adaptive embedding (UAE) method for DR to solve these challenges, which is a linear graph-embedding method. First, an adaptive allocation method of neighbors is proposed to construct the affinity graph. Second, the construction of affinity graph and calculation of projection matrix are integrated together. It considers the local relationship between samples and global characteristic of high-dimensional data, in which the cleaned data matrix is originally proposed to remove noise in subspace. The relationship between our method and local preserving projections (LPPs) is also explored. Finally, an alternative iteration optimization algorithm is derived to solve our model, the convergence and computational complexity of which are also analyzed. Comprehensive experiments on synthetic and benchmark datasets illustrate the superiority of our method.
引用
收藏
页码:6844 / 6855
页数:12
相关论文
共 50 条
  • [21] Locally Minimizing Embedding and Globally Maximizing Variance: Unsupervised Linear Difference Projection for Dimensionality Reduction
    Minghua Wan
    Zhihui Lai
    Zhong Jin
    [J]. Neural Processing Letters, 2011, 33 : 267 - 282
  • [22] Unsupervised dimensionality reduction by jointing dynamic hypergraph and low-rank embedding for classification and clustering
    Li, Lin
    Li, Zhaoni
    Zheng, Jian
    Qu, Hongchun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 208
  • [23] Sparse Unsupervised Dimensionality Reduction Algorithms
    Dou, Wenjun
    Dai, Guang
    Xu, Congfu
    Zhang, Zhihua
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I: EUROPEAN CONFERENCE, ECML PKDD 2010, 2010, 6321 : 361 - 376
  • [24] An unsupervised dimensionality-reduction technique
    Llobet, E
    Gualdron, O
    Brezmes, J
    Vilanova, X
    Correig, X
    [J]. 2005 IEEE SENSORS, VOLS 1 AND 2, 2005, : 1018 - 1021
  • [25] Unsupervised dimensionality reduction for exposome research
    Kalia, Vrinda
    Walker, Douglas, I
    Krasnodemski, Katherine M.
    Jones, Dean P.
    Miller, Gary W.
    Kioumourtzoglou, Marianthi-Anna
    [J]. CURRENT OPINION IN ENVIRONMENTAL SCIENCE & HEALTH, 2020, 15 : 32 - 38
  • [26] Analysis of Unsupervised Dimensionality Reduction Techniques
    Kumar, Ch. Aswani
    [J]. COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2009, 6 (02) : 217 - 227
  • [27] Maximal Linear Embedding for Dimensionality Reduction
    Wang, Ruiping
    Shan, Shiguang
    Chen, Xilin
    Chen, Jie
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (09) : 1776 - 1792
  • [28] Dimensionality Reduction for Graph of Words Embedding
    Gibert, Jaume
    Valveny, Ernest
    Bunke, Horst
    [J]. GRAPH-BASED REPRESENTATIONS IN PATTERN RECOGNITION, 2011, 6658 : 22 - 31
  • [29] Spline embedding for nonlinear dimensionality reduction
    Xiang, Shiming
    Niel, Feiping
    Zhang, Changshui
    Zhang, Chunxia
    [J]. MACHINE LEARNING: ECML 2006, PROCEEDINGS, 2006, 4212 : 825 - 832
  • [30] Dimensionality reduction for graph of words embedding
    Gibert J.
    Valveny E.
    Bunke H.
    [J]. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2011, 6658 LNCS : 22 - 31