Accelerating t-SNE using Tree-Based Algorithms

被引:0
|
作者
van der Maaten, Laurens [1 ]
机构
[1] Delft Univ Technol, Pattern Recognit & Bioinformat Grp, NL-2628 CD Delft, Netherlands
关键词
embedding; multidimensional scaling; t-SNE; space-partitioning trees; Barnes-Hut algorithm; dual-tree algorithm; NONLINEAR DIMENSIONALITY REDUCTION; ERROR ESTIMATE; OBJECT; CODE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The paper investigates the acceleration of t-SNE an embedding technique that is commonly used for the visualization of high-dimensional data in scatter plots using two treebased algorithms. In particular, the paper develops variants of the Barnes-Hut algorithm and of the dual-tree algorithm that approximate the gradient used for learning t-SNE embeddings in 0(N log N). Our experiments show that the resulting algorithms substantially accelerate t-SNE, and that they make it possible to learn embeddings of data sets with millions of objects. Somewhat counterintuitively, the Barnes-Hut variant of t-SNE appears to outperform the dual-tree variant.
引用
收藏
页码:3221 / 3245
页数:25
相关论文
共 50 条
  • [1] Accelerating t-SNE using tree-based algorithms
    Van Der Maaten, Laurens
    [J]. Journal of Machine Learning Research, 2015, 15 : 3221 - 3245
  • [2] Accelerating Hyperbolic t-SNE
    Skrodzki, Martin
    van Geffen, Hunter
    Chaves-de-Plaza, Nicolas F.
    Hollt, Thomas
    Eisemann, Elmar
    Hildebrandt, Klaus
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) : 4403 - 4415
  • [3] Conditional t-SNE: more informative t-SNE embeddings
    Kang, Bo
    Garcia Garcia, Dario
    Lijffijt, Jefrey
    Santos-Rodriguez, Raul
    De Bie, Tijl
    [J]. MACHINE LEARNING, 2021, 110 (10) : 2905 - 2940
  • [4] Barnes-Hut approximation based accelerating t-SNE for seizure detection
    Rukhsar, Salim
    Tiwari, Anil Kumar
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 84
  • [5] Conditional t-SNE: More informative t-SNE embeddings
    Kang, Bo
    Garcia, Dario Garcia
    Lijffijt, Jefrey
    Santos-Rodriguez, Raul
    De Bie, Tijl
    [J]. 2021 IEEE 8TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2021,
  • [6] Conditional t-SNE: more informative t-SNE embeddings
    Bo Kang
    Darío García García
    Jefrey Lijffijt
    Raúl Santos-Rodríguez
    Tijl De Bie
    [J]. Machine Learning, 2021, 110 : 2905 - 2940
  • [7] Visualizing Data using t-SNE
    van der Maaten, Laurens
    Hinton, Geoffrey
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2008, 9 : 2579 - 2605
  • [8] DT-SNE: t-SNE discrete visualizations as decision tree structures
    Bibal, Adrien
    Delchevalerie, Valentin
    Frenay, Benoit
    [J]. NEUROCOMPUTING, 2023, 529 : 101 - 112
  • [9] Visualizing data using t-SNE
    TiCC, Ttlburg University, P.O. Box 90153, 5000 LE Tilburg, Netherlands
    不详
    [J]. J. Mach. Learn. Res, 2008, (2579-2625):
  • [10] Wasserstein t-SNE
    Bachmann, Fynn
    Hennig, Philipp
    Kobak, Dmitry
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I, 2023, 13713 : 104 - 120