Self-supervised Dimensionality Reduction with Neural Networks and Pseudo-labeling

被引:6
|
作者
Espadoto, Mateus [1 ,3 ]
Hirata, Nina [1 ]
Telea, Alexandru [2 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Groningen, Dept Informat & Comp Sci, Utrecht, Netherlands
[3] Univ Groningen, Johann Bernoulli Inst, Groningen, Netherlands
基金
巴西圣保罗研究基金会;
关键词
Dimensionality Reduction; Machine Learning; Neural Networks; Autoencoders;
D O I
10.5220/0010184800270037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dimensionality reduction (DR) is used to explore high-dimensional data in many applications. Deep learning techniques such as autoencoders have been used to provide fast, simple to use, and high-quality DR. However, such methods yield worse visual cluster separation than popular methods such as t-SNE and UMAP. We propose a deep learning DR method called Self-Supervised Network Projection (SSNP) which does DR based on pseudo-labels obtained from clustering. We show that SSNP produces better cluster separation than autoencoders, has out-of-sample, inverse mapping, and clustering capabilities, and is very fast and easy to use.
引用
收藏
页码:27 / 37
页数:11
相关论文
共 50 条
  • [1] Self-Supervised Wasserstein Pseudo-Labeling for Semi-Supervised Image Classification
    Taherkhani, Fariborz
    Dabouei, Ali
    Soleymani, Sobhan
    Dawson, Jeremy
    Nasrabadi, Nasser M.
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12262 - 12272
  • [2] Rethinking Pseudo-Labeling for Semi-Supervised Facial Expression Recognition With Contrastive Self-Supervised Learning
    Fang, Bei
    Li, Xian
    Han, Guangxin
    He, Juhou
    [J]. IEEE ACCESS, 2023, 11 : 45547 - 45558
  • [3] A Semi-Supervised Learning Method for Spiking Neural Networks Based on Pseudo-Labeling
    Nguyen, Thao N. N.
    Veeravalli, Bharadwaj
    Fong, Xuanyao
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [4] Iterative ensemble pseudo-labeling for convolutional neural networks
    Yildiz, Serdar
    Amasyali, Mehmet Fatih
    [J]. SIGMA JOURNAL OF ENGINEERING AND NATURAL SCIENCES-SIGMA MUHENDISLIK VE FEN BILIMLERI DERGISI, 2024, 42 (03): : 862 - 874
  • [5] Informative pseudo-labeling for graph neural networks with few labels
    Yayong Li
    Jie Yin
    Ling Chen
    [J]. Data Mining and Knowledge Discovery, 2023, 37 : 228 - 254
  • [6] Multitemporal Speckle Reduction With Self-Supervised Deep Neural Networks
    Meraoumia, Ines
    Dalsasso, Emanuele
    Denis, Loic
    Abergel, Remy
    Tupin, Florence
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Informative pseudo-labeling for graph neural networks with few labels
    Li, Yayong
    Yin, Jie
    Chen, Ling
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2023, 37 (01) : 228 - 254
  • [8] Uncertainty-Confidence Fused Pseudo-labeling for Graph Neural Networks
    Long, Pingjiang
    Jian, Zihao
    Liu, Xiangrong
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 331 - 342
  • [9] Dysarthric Speech Recognition Using Pseudo-Labeling, Self-Supervised Feature Learning, and a Joint Multi-Task Learning Approach
    Takashima, Ryoichi
    Sawa, Yuya
    Aihara, Ryo
    Takiguchi, Tetsuya
    Imai, Yoshie
    [J]. IEEE ACCESS, 2024, 12 : 36990 - 36999
  • [10] Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised Learning
    Cascante-Bonilla, Paola
    Tan, Fuwen
    Qi, Yanjun
    Ordonez, Vicente
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 6912 - 6920