Hardware-aware Model Architecture for Ternary Spiking Neural Networks

被引:0
|
作者
Wu, Nai-Chun [1 ]
Chen, Tsu-Hsiang [1 ]
Huang, Chih-Tsun [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Comp Sci, Hsinchu, Taiwan
关键词
D O I
10.1109/VLSI-TSA/VLSI-DAT57221.2023.10134319
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a hardware-aware model architecture for ternary spiking neural networks. Under realistic hardware constraints, an effective training flow is proposed with ternary model weights and quantized voltage thresholds. In addition to the enhanced output decoding of the last-50%-spike to prevent the warm-up issue, our network also incorporates a hybrid architecture by attaching two simple fully-connected artificial neural layers as the output stage. Transforming from the asymmetrical ResNeXt architecture, the proposed SNN achieves a top-1 accuracy of 90% on the CIFAR-10 dataset, with a 5.9% improvement compared to the baseline model.
引用
下载
收藏
页数:4
相关论文
共 50 条
  • [1] Fast Hardware-Aware Neural Architecture Search
    Zhang, Li Lyna
    Yang, Yuqing
    Jiang, Yuhang
    Zhu, Wenwu
    Liu, Yunxin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2959 - 2967
  • [2] Pareto Rank Surrogate Model for Hardware-aware Neural Architecture Search
    Benmeziane, Hadjer
    Niar, Smail
    Ouarnoughi, Hamza
    El Maghraoui, Kaoutar
    2022 IEEE INTERNATIONAL SYMPOSIUM ON PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE (ISPASS 2022), 2022, : 267 - 276
  • [3] Hardware-Aware Neural Architecture Search: Survey and Taxonomy
    Benmeziane, Hadjer
    El Maghraoui, Kaoutar
    Ouarnoughi, Hamza
    Niar, Smail
    Wistuba, Martin
    Wang, Naigang
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4322 - 4329
  • [4] Evolution of Hardware-Aware Neural Architecture Search on the Edge
    Richey, Blake
    Clay, Mitchell
    Grecos, Christos
    Shirvaikar, Mukul
    REAL-TIME IMAGE PROCESSING AND DEEP LEARNING 2023, 2023, 12528
  • [5] Hardware-Aware Softmax Approximation for Deep Neural Networks
    Geng, Xue
    Lin, Jie
    Zhao, Bin
    Kong, Anmin
    Aly, Mohamed M. Sabry
    Chandrasekhar, Vijay
    COMPUTER VISION - ACCV 2018, PT IV, 2019, 11364 : 107 - 122
  • [6] HAO: Hardware-aware Neural Architecture Optimization for Efficient Inference
    Dong, Zhen
    Gao, Yizhao
    Huang, Qijing
    Wawrzynek, John
    So, Hayden K. H.
    Keutzer, Kurt
    2021 IEEE 29TH ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES (FCCM 2021), 2021, : 50 - 59
  • [7] Hardware-Aware Bayesian Neural Architecture Search of Quantized CNNs
    Perrin, Mathieu
    Guicquero, William
    Paille, Bruno
    Sicard, Gilles
    IEEE Embedded Systems Letters, 2025, 17 (01) : 42 - 45
  • [8] Hardware-Aware Zero-Shot Neural Architecture Search
    Yoshihama, Yutaka
    Yadani, Kenichi
    Isobe, Shota
    2023 18TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND APPLICATIONS, MVA, 2023,
  • [9] Generating Neural Networks for Diverse Networking Classification Tasks via Hardware-Aware Neural Architecture Search
    Xie, Guorui
    Li, Qing
    Shi, Zhenning
    Fang, Hanbin
    Ji, Shengpeng
    Jiang, Yong
    Yuan, Zhenhui
    Ma, Lianbo
    Xu, Mingwei
    IEEE TRANSACTIONS ON COMPUTERS, 2024, 73 (02) : 481 - 494
  • [10] Hardware-aware neural architecture search for stochastic computing-based neural networks on tiny devices
    Song, Yuhong
    Sha, Edwin Hsing-Mean
    Zhuge, Qingfeng
    Xu, Rui
    Xu, Xiaowei
    Li, Bingzhe
    Yang, Lei
    JOURNAL OF SYSTEMS ARCHITECTURE, 2023, 135