Self-Supervised Spiking Neural Networks applied to Digit Classification

被引:3
|
作者
Chamand, Benjamin [1 ]
Joly, Philippe [1 ]
机构
[1] Univ Toulouse, IRIT, CNRS, Toulouse INP,UT3, Toulouse, France
关键词
spiking neural networks; self-supervised learning; representation learning; computer vision;
D O I
10.1145/3549555.3549559
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The self-supervised learning (SSL) paradigm is a rapidly growing research area in recent years with promising results, especially in the field of image processing. In order for these models to converge towards the creation of discriminative representations, a data augmentation is applied to the input data that feeds two-branch networks. On the other hand, Spiking Neural Networks (SNNs) are attracting a growing community due to their ability to process temporal information, their low-energy consumption and their high biological plausibility. Thanks to the use of Poisson process stochasticity to encode the same data into different temporal representations, and the success of using surrogate gradient on learning, we propose a self-supervised learning method applied to an SNN network, and we make a preliminary study on the generated representations. We have shown its feasibility by training our architecture on a dataset of images of digits (MNIST), then we have evaluated the representations with two classification methods.
引用
收藏
页码:196 / 200
页数:5
相关论文
共 50 条
  • [41] MOBILE ROBOT CONTROL BY NEURAL NETWORKS USING SELF-SUPERVISED LEARNING
    SAGA, K
    SUGASAKA, T
    SEKIGUCHI, M
    NAGATA, S
    ASAKAWA, K
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 1992, 39 (06) : 537 - 542
  • [42] Self-Supervised Graph Neural Networks for Session-Based Recommendation
    Wang, Yonggui
    Zhao, Xiaoxuan
    Computer Engineering and Applications, 59 (03): : 244 - 252
  • [43] From Canonical Correlation Analysis to Self-supervised Graph Neural Networks
    Zhang, Hengrui
    Wu, Qitian
    Yan, Junchi
    Wipf, David
    Yu, Philip S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [44] Review on self-supervised image recognition using deep neural networks
    Ohri, Kriti
    Kumar, Mukesh
    KNOWLEDGE-BASED SYSTEMS, 2021, 224
  • [45] Randomly connected neural networks for self-supervised monocular depth estimation
    Tukra, Samyakh
    Giannarou, Stamatia
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2022, 10 (04): : 390 - 399
  • [46] Self-supervised Single-Image Deconvolution with Siamese Neural Networks
    Papkov, Mikhail
    Palo, Kaupo
    Parts, Leopold
    DATA AUGMENTATION, LABELLING, AND IMPERFECTIONS, DALI 2023, 2024, 14379 : 157 - 166
  • [47] Self-Supervised Graph Neural Networks for Accurate Prediction of Neel Temperature
    Kong, Jian-Gang
    Li, Qing-Xu
    Li, Jian
    Liu, Yu
    Zhu, Jia-Ji
    CHINESE PHYSICS LETTERS, 2022, 39 (06)
  • [48] Self-supervised Dimensionality Reduction with Neural Networks and Pseudo-labeling
    Espadoto, Mateus
    Hirata, Nina
    Telea, Alexandru
    IVAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 3: IVAPP, 2021, : 27 - 37
  • [49] Self-Supervised Visual Feature Learning With Deep Neural Networks: A Survey
    Jing, Longlong
    Tian, Yingli
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 4037 - 4058
  • [50] Self-Supervised Neural Topic Modeling
    Bahrainian, Seyed Ali
    Jaggi, Martin
    Eickhoff, Carsten
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 3341 - 3350