Local Linear Embedding with Adaptive Neighbors

被引:19
|
作者
Xue, Jiaqi [1 ]
Zhang, Bin [1 ]
Qiang, Qianyao [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian 710049, Peoples R China
关键词
dimensionality reduction; Locally Linear Embedding; manifold learning; adaptive neighbor strategy; DIMENSIONALITY REDUCTION; FRAMEWORK;
D O I
10.1016/j.patcog.2022.109205
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dimensionality reduction is one of the most important techniques in the field of data mining. It em-beds high-dimensional data into a low-dimensional vector space while keeping the main information as much as possible. Locally Linear Embedding (LLE) as a typical manifold learning algorithm computes neighborhood preserving embeddings of high-dimensional inputs. Based on the thought of LLE, we pro-pose a novel unsupervised dimensionality reduction model called Local Linear Embedding with Adaptive Neighbors (LLEAN). To achieve a desirable dimensionality reduction result, we impose adaptive neighbor strategy and adopt a projection matrix to project data into an optimal subspace. The relationship between every pair-wise data is investigated to help reveal the data structure. Augmented Lagrangian Multiplier (ALM) is devised in optimization procedure to effectively solve the proposed objective function. Com-prehensive experiments on toy data and benchmark datasets have been done and the results show that LLEAN outperforms other state-of-the-art dimensionality reduction methods. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Global and local choice of the number of nearest neighbors in locally linear embedding
    Alvarez-Meza, Andres
    Valencia-Aguirre, Juliana
    Daza-Santacoloma, Genaro
    Castellanos-Dominguez, German
    PATTERN RECOGNITION LETTERS, 2011, 32 (16) : 2171 - 2177
  • [2] Dual-weight local linear embedding algorithm based on adaptive neighborhood
    Zhang, Yansheng
    Zhang, Rui
    Gao-zhiwei, Haishuang
    Yin, Haishuang
    TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2023, 45 (08) : 1411 - 1421
  • [3] Local linear transformation embedding
    Hou, Chenping
    Wang, Jing
    Wu, Yi
    Yi, Dongyun
    NEUROCOMPUTING, 2009, 72 (10-12) : 2368 - 2378
  • [4] Automatic Choice of the Number of Nearest Neighbors in Locally Linear Embedding
    Valencia-Aguirre, Juliana
    Alvarez-Mesa, Andres
    Daza-Santacoloma, Genaro
    Castellanos-Dominguez, German
    PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, PROCEEDINGS, 2009, 5856 : 77 - 84
  • [5] Hierarchical Neighbors Embedding
    Liu, Shenglan
    Yu, Yang
    Liu, Kaiyuan
    Wang, Feilong
    Wen, Wujun
    Qiao, Hong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 7816 - 7829
  • [6] Adaptive Local Neighbors for Transfer Discriminative Feature Learning
    Wang, Wei
    Wang, Zhihui
    Li, Haojie
    Zhou, Juan
    Ding, Zhengming
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 1595 - 1602
  • [7] Mutual neighbors and diagonal loading-based sparse locally linear embedding
    Hajizadeh, Rassoul
    Aghagolzadeh, Ali
    Ezoji, Mehdi
    APPLIED ARTIFICIAL INTELLIGENCE, 2018, 32 (05) : 496 - 514
  • [8] Globalizing local neighborhood for locally linear embedding
    Wen, Guihua
    Jiang, Lijun
    2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 3491 - +
  • [9] An improved weighted local linear embedding algorithm
    Wu, Qing
    Qi, Zongxian
    Wang, Zhicang
    Zhang, Yu
    2018 14TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2018, : 378 - 381
  • [10] CLASSIFICATION OF STELLAR SPECTRA WITH LOCAL LINEAR EMBEDDING
    Daniel, Scott F.
    Connolly, Andrew
    Schneider, Jeff
    Vanderplas, Jake
    Xiong, Liang
    ASTRONOMICAL JOURNAL, 2011, 142 (06):