Fully Parallel Stochastic Computing Hardware Implementation of Convolutional Neural Networks for Edge Computing Applications

被引:17
|
作者
Frasser, Christiam F. [1 ]
Linares-Serrano, Pablo [2 ]
de los Rios, Ivan Diez [2 ]
Moran, Alejandro [1 ]
Skibinsky-Gitlin, Erik S. [1 ]
Font-Rossello, Joan [1 ,3 ]
Canals, Vincent [1 ,3 ]
Roca, Miquel [1 ,3 ]
Serrano-Gotarredona, Teresa [2 ]
Rossello, Josep L. [1 ,3 ]
机构
[1] Univ Balearic Isl, Elect Engn Grp, Ind Engn & Construct Dept, Palma De Mallorca 07122, Spain
[2] CSIC, Inst Microelect Sevilla, IMSE, CNM, Seville 41092, Spain
[3] Balearic Isl Hlth Res Inst IdISBa, Palma De Mallorca 07120, Spain
关键词
Logic gates; Hardware; Correlation; Computer architecture; Convolutional neural networks; Internet of Things; Europe; Convolutional neural networks (CNNs); edge computing (EC); stochastic computing (SC);
D O I
10.1109/TNNLS.2022.3166799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Edge artificial intelligence (AI) is receiving a tremendous amount of interest from the machine learning community due to the ever-increasing popularization of the Internet of Things (IoT). Unfortunately, the incorporation of AI characteristics to edge computing devices presents the drawbacks of being power and area hungry for typical deep learning techniques such as convolutional neural networks (CNNs). In this work, we propose a power-and-area efficient architecture based on the exploitation of the correlation phenomenon in stochastic computing (SC) systems. The proposed architecture solves the challenges that a CNN implementation with SC (SC-CNN) may present, such as the high resources used in binary-to-stochastic conversion, the inaccuracy produced by undesired correlation between signals, and the complexity of the stochastic maximum function implementation. To prove that our architecture meets the requirements of edge intelligence realization, we embed a fully parallel CNN in a single field-programmable gate array (FPGA) chip. The results obtained showed a better performance than traditional binary logic and other SC implementations. In addition, we performed a full VLSI synthesis of the proposed design, showing that it presents better overall characteristics than other recently published VLSI architectures.
引用
收藏
页码:10408 / 10418
页数:11
相关论文
共 50 条
  • [1] Stochastic Computing for Hardware Implementation of Binarized Neural Networks
    Hirtzlin, Tifenn
    Penkovsky, Bogdan
    Bocquet, Marc
    Klein, Jacques-Olivier
    Portal, Jean-Michel
    Querlioz, Damien
    [J]. IEEE ACCESS, 2019, 7 : 76394 - 76403
  • [2] Accurate and Efficient Stochastic Computing Hardware for Convolutional Neural Networks
    Yu, Joonsang
    Kim, Kyounghoon
    Lee, Jongeun
    Choi, Kiyoung
    [J]. 2017 IEEE 35TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2017, : 105 - 112
  • [3] A Review of Convolutional Neural Networks Hardware Accelerators for AIoT Edge Computing
    Wu, Fei
    Zhao, Neng
    Liu, Ye
    Chang, Liang
    Zhou, Liang
    Zhou, Jun
    [J]. 2021 6TH INTERNATIONAL CONFERENCE ON UK-CHINA EMERGING TECHNOLOGIES (UCET 2021), 2021, : 71 - 76
  • [4] Hartley Stochastic Computing For Convolutional Neural Networks
    Mozafari, S. H.
    Clark, J. J.
    Gross, W. J.
    Meyer, B. H.
    [J]. 2021 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS 2021), 2021, : 235 - 240
  • [5] Stochastic computing in convolutional neural network implementation: a review
    Lee, Yang Yang
    Halim, Zaini Abdul
    [J]. PEERJ COMPUTER SCIENCE, 2020, 6
  • [6] STOCHASTIC COMPUTING HARDWARE DESIGN AND OPTIMIZATION FOR CONVOLUTIONAL NEUTRAL NETWORKS
    Chen, Zhinan
    Wang, Haoyu
    Xu, Yiming
    Li, Zili
    Zhao, Yudi
    Xiong, Shisheng
    [J]. CONFERENCE OF SCIENCE & TECHNOLOGY FOR INTEGRATED CIRCUITS, 2024 CSTIC, 2024,
  • [7] A Survey of Convolutional Neural Networks on Edge with Reconfigurable Computing
    Vestias, Mario P.
    [J]. ALGORITHMS, 2019, 12 (08)
  • [8] Reconfigurable spatial-parallel stochastic computing for accelerating sparse convolutional neural networks
    Zihan XIA
    Rui WAN
    Jienan CHEN
    Runsheng WANG
    [J]. Science China(Information Sciences), 2023, 66 (06) : 267 - 286
  • [9] An Efficient Hardware Implementation of Activation Functions Using Stochastic Computing for Deep Neural Networks
    Van-Tinh Nguyen
    Tieu-Khanh Luong
    Han Le Duc
    Van-Phuc Hoang
    [J]. 2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2018), 2018, : 233 - 236
  • [10] Reconfigurable spatial-parallel stochastic computing for accelerating sparse convolutional neural networks
    Xia, Zihan
    Wan, Rui
    Chen, Jienan
    Wang, Runsheng
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2023, 66 (06)