DNN pruning and mapping on NoC-Based communication infrastructure

被引:15
|
作者
Mirmahaleh, Seyedeh Yasaman Hosseini [1 ]
Rahmani, Amir Masoud [1 ]
机构
[1] Islamic Azad Univ, Sci & Res Branch, Dept Comp Engn, Tehran, Iran
关键词
Deep neural network (DNN); Network on chip (NoC); DNN mapping; Dataflow mapping; Weight and neuron pruning (WNP);
D O I
10.1016/j.mejo.2019.104655
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Machine learning algorithm-based applications have been deployed for supporting the intemet of things (IoT) and web search engines without losing accuracy in order to satisfy human requests. Developments in deep learning-based applications and complexity of machine learning algorithms increase the depth of artificial neural networks (ANN). Increasing depth of neural network (NN) is challenging regarding the delay, energy consumption, learning, and inference speed up. We train a deep neural network (DNN) gradient descent-based method based on two Booth and Matyas standard generating functions. We also propose a method for pruning weights, neurons, and layers of DNNs based on minimal distance error before and after pruning in a range of safety margin error. This paper employs a new elastic dataflow and DNN mapping on the mesh topology for decreasing delay and energy consumption. Simulation results show reducing the delay and energy consumption of training and inference phases by approximately 22.56%-77% and 65.94%-88.54% compared with not employing a DNN pruning.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Effects of the NoC Architecture in the Performance of NoC-based MPSoCs
    Silva, Douglas R. G.
    Oliveira, Bruno S.
    Moraes, Fernando G.
    2014 21ST IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2014, : 431 - 434
  • [32] Energy-Aware Dynamic Task Mapping for NoC-based MPSoCs
    Mandelli, Marcelo
    Ost, Luciano
    Carara, Everton
    Guindani, Guilherme
    Gouvea, Thiago
    Medeiros, Guilherme
    Moraes, Fernando G.
    2011 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2011, : 1676 - 1679
  • [33] Accelerating NoC-based MPI Primitives via Communication Architecture Customization
    Huang, Libo
    Wang, Zhiying
    Xiao, Nong
    2012 IEEE 23RD INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP), 2012, : 141 - 148
  • [34] Timing attack on NoC-based systems: Prime plus Probe attack and NoC-based protection
    Reinbrecht, Cezar
    Susin, Altamiro
    Bossuet, Lilian
    Sigl, Georg
    Sepulveda, Johanna
    MICROPROCESSORS AND MICROSYSTEMS, 2017, 52 : 556 - 565
  • [35] Congestion-aware task mapping in NoC-based MPSoCs with dynamic workload
    Carvalho, Ewerson
    Calazans, Ney
    Moraes, Fernando
    IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI, PROCEEDINGS: EMERGING VLSI TECHNOLOGIES AND ARCHITECTURES, 2007, : 459 - +
  • [36] Exploring Tabu Search Based Algorithms for Mapping and Placement in NoC-based Reconfigurable Systems
    Silva Novaes, Guilherme A.
    Moreira, Luiz Carlos
    Chau, Wang Jiang
    2019 32ND SYMPOSIUM ON INTEGRATED CIRCUITS AND SYSTEMS DESIGN (SBCCI 2019), 2019,
  • [37] Preprocessing-based Run-time Mapping of Applications on NoC-based MPSoCs
    Kaushik, Samarth
    Singh, Amit Kumar
    Srikanthan, Thambipillai
    2011 IEEE COMPUTER SOCIETY ANNUAL SYMPOSIUM ON VLSI (ISVLSI), 2011, : 337 - 338
  • [38] Energy-Aware and Reliability-Aware Mapping for NoC-Based Architectures
    Naresh Kumar Reddy Beechu
    Vasantha Moodabettu Harishchandra
    Nithin Kumar Yernad Balachandra
    Wireless Personal Communications, 2018, 100 : 213 - 225
  • [39] An energy-aware online task mapping algorithm in NoC-based system
    Bin Xie
    Tianzhou Chen
    Wei Hu
    Xingsheng Tang
    Dazhou Wang
    The Journal of Supercomputing, 2013, 64 : 1021 - 1037
  • [40] Energy-Aware and Reliability-Aware Mapping for NoC-Based Architectures
    Beechu, Naresh Kumar Reddy
    Harishchandra, Vasantha Moodabettu
    Balachandra, Nithin Kumar Yernad
    WIRELESS PERSONAL COMMUNICATIONS, 2018, 100 (02) : 213 - 225