Nonrigid embeddings for dimensionality reduction

被引:0
|
作者
Brand, M [1 ]
机构
[1] Mitsubishi Elect Res Labs, Cambridge, MA USA
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
=Spectral methods for embedding graphs and immersing data manifolds in low-dimensional spaces are notoriously unstable due to insufficient and/or numerically ill-conditioned constraint sets. Why show why this is endemic to spectral methods, and develop low-complexity solutions for stiffening ill-conditioned problems and regularizing ill-posed problems, with proofs of correctness. The regularization exploits sparse but complementary constraints on affine rigidity and edge lengths to obtain isometric embeddings. An implemented algorithm is fast, accurate, and industrial-strength: Experiments with problem sizes spanning four orders of magnitude show O(N) scaling. We demonstrate with speech data.
引用
收藏
页码:47 / 59
页数:13
相关论文
共 50 条
  • [1] Effective Dimensionality Reduction for Word Embeddings
    Raunak, Vikas
    Gupta, Vivek
    Metze, Florian
    4TH WORKSHOP ON REPRESENTATION LEARNING FOR NLP (REPL4NLP-2019), 2019, : 235 - 243
  • [2] Dimensionality Reduction with Evolutionary Shephard-Kruskal Embeddings
    Kramer, Oliver
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM 2018), 2018, : 478 - 481
  • [3] Dimensionality Reduction Using Similarity-Induced Embeddings
    Passalis, Nikolaos
    Tefas, Anastasios
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (08) : 3429 - 3441
  • [4] Dimensionality Reduction on the Cartesian Product of Embeddings of Multiple Dissimilarity Matrices
    Zhiliang Ma
    Adam Cardinal-Stakenas
    Youngser Park
    Michael W. Trosset
    Carey E. Priebe
    Journal of Classification, 2010, 27 : 307 - 321
  • [5] Nonlinear supervised dimensionality reduction via smooth regular embeddings
    Ornek, Cem
    Vural, Elif
    PATTERN RECOGNITION, 2019, 87 : 55 - 66
  • [6] Dimensionality Reduction on the Cartesian Product of Embeddings of Multiple Dissimilarity Matrices
    Ma, Zhiliang
    Cardinal-Stakenas, Adam
    Park, Youngser
    Trosset, Michael W.
    Priebe, Carey E.
    JOURNAL OF CLASSIFICATION, 2010, 27 (03) : 307 - 321
  • [7] On the Dimensionality of Sentence Embeddings
    Wang, Hongwei
    Zhang, Hongming
    Yu, Dong
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 10344 - 10354
  • [8] ZADU: A Python']Python Library for Evaluating the Reliability of Dimensionality Reduction Embeddings
    Jeon, Hyeon
    Cho, Aeri
    Jang, Jinhwa
    Lee, Soohyun
    Hyun, Jake
    Ko, Hyung-Kwon
    Jo, Jaemin
    Seo, Jinwook
    2023 IEEE VISUALIZATION AND VISUAL ANALYTICS, VIS, 2023, : 196 - 200
  • [9] Performance Improvement of Semantic Search Using Sentence Embeddings by Dimensionality Reduction
    Tsumuraya, Kenshin
    Uehara, Minoru
    Adachi, Yoshihiro
    Lecture Notes on Data Engineering and Communications Technologies, 2024, 201 : 123 - 132
  • [10] Performance Improvement of Semantic Search Using Sentence Embeddings by Dimensionality Reduction
    Tsumuraya, Kenshin
    Uehara, Minoru
    Adachi, Yoshihiro
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 3, AINA 2024, 2024, 201 : 123 - 132