SPENSER: Towards a NeuroEvolutionary Approach for Convolutional Spiking Neural Networks

被引:1
|
作者
Branquinho, Henrique [1 ]
Lourenco, Nuno [1 ]
Costa, Ernesto [1 ]
机构
[1] Univ Coimbra, CISUC, DEI, Coimbra, Portugal
关键词
spiking neural networks; neuroevolution; DENSER; computer vision; BACKPROPAGATION;
D O I
10.1145/3583133.3596399
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spiking Neural Networks (SNNs) have attracted recent interest due to their energy efficiency and biological plausibility. However, the performance of SNNs still lags behind traditional Artificial Neural Networks (ANNs), as there is no consensus on the best learning algorithm for SNNs. Best-performing SNNs are based on ANN to SNN conversion or learning with spike-based backpropagation through surrogate gradients. The focus of recent research has been on developing and testing different learning strategies, with hand-tailored architectures and parameter tuning. Neuroevolution (NE), has proven successful as a way to automatically design ANNs and tune parameters, but its applications to SNNs are still at an early stage. DENSER is a NE framework for the automatic design and parametrization of ANNs, based on the principles of Genetic Algorithms (GA) and Structured Grammatical Evolution (SGE). In this paper, we propose SPENSER, a NE framework for SNN generation based on DENSER, for image classification on the MNIST and Fashion-MNIST datasets. SPENSER generates competitive performing networks with a test accuracy of 99.42% and 91.65% respectively.
引用
收藏
页码:2115 / 2122
页数:8
相关论文
共 50 条
  • [41] Hybrid photonic deep convolutional residual spiking neural networks for text classification
    Zhang, Yahui
    Xiang, Shuiying
    Jiang, Shuqing
    Han, Yanan
    Guo, Xingxing
    Zheng, Ling
    Shi, Yuechun
    Hao, Yue
    OPTICS EXPRESS, 2023, 31 (17): : 28489 - 28502
  • [42] An adaptive threshold mechanism for accurate and efficient deep spiking convolutional neural networks
    Chen, Yunhua
    Mai, Yingchao
    Feng, Ren
    Xiao, Jinsheng
    NEUROCOMPUTING, 2022, 469 : 189 - 197
  • [43] STDP-based spiking deep convolutional neural networks for object recognition
    Kheradpisheh, Saeed Reza
    Ganjtabesh, Mohammad
    Thorpe, Simon J.
    Masquelier, Timothee
    NEURAL NETWORKS, 2018, 99 : 56 - 67
  • [44] An Analog Neuron Circuit for Spiking Convolutional Neural Networks Based on Flash Array
    Xiaofeng, Gu
    Yanhang, Liu
    Zhiguo, Yu
    Xiaoyu, Zhong
    Xuan, Chen
    Yi, Sun
    Hongbing, Pan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (01) : 116 - 124
  • [45] Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System
    Zou, Chenglong
    Wang, Xinan
    Xu, Boxing
    Kuang, Yisong
    Cui, Xiaoxin
    2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2019,
  • [46] Towards Explainability of non-Convolutional Neural Networks
    Doese, Jonas
    Weis, Torben
    UBICOMP/ISWC '21 ADJUNCT: PROCEEDINGS OF THE 2021 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2021 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2021, : 100 - 103
  • [47] Towards lightweight convolutional neural networks for object detection
    Anisimov, Dmitriy
    Khanova, Tatiana
    2017 14TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2017,
  • [48] Towards Improved Input Masking for Convolutional Neural Networks
    Balasubramanian, Sriram
    Feizi, Soheil
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 1855 - 1865
  • [49] Towards Near Data Processing of Convolutional Neural Networks
    Das, Palash
    Lakhotia, Shivam
    Shetty, Prabodh
    Kapoor, Hemangee K.
    2018 31ST INTERNATIONAL CONFERENCE ON VLSI DESIGN AND 2018 17TH INTERNATIONAL CONFERENCE ON EMBEDDED SYSTEMS (VLSID & ES), 2018, : 380 - 385
  • [50] Towards Better Analysis of Deep Convolutional Neural Networks
    Liu, Mengchen
    Shi, Jiaxin
    Li, Zhen
    Li, Chongxuan
    Zhu, Jun
    Liu, Shixia
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2017, 23 (01) : 91 - 100