DNN pruning and mapping on NoC-Based communication infrastructure

被引:15
|
作者
Mirmahaleh, Seyedeh Yasaman Hosseini [1 ]
Rahmani, Amir Masoud [1 ]
机构
[1] Islamic Azad Univ, Sci & Res Branch, Dept Comp Engn, Tehran, Iran
关键词
Deep neural network (DNN); Network on chip (NoC); DNN mapping; Dataflow mapping; Weight and neuron pruning (WNP);
D O I
10.1016/j.mejo.2019.104655
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Machine learning algorithm-based applications have been deployed for supporting the intemet of things (IoT) and web search engines without losing accuracy in order to satisfy human requests. Developments in deep learning-based applications and complexity of machine learning algorithms increase the depth of artificial neural networks (ANN). Increasing depth of neural network (NN) is challenging regarding the delay, energy consumption, learning, and inference speed up. We train a deep neural network (DNN) gradient descent-based method based on two Booth and Matyas standard generating functions. We also propose a method for pruning weights, neurons, and layers of DNNs based on minimal distance error before and after pruning in a range of safety margin error. This paper employs a new elastic dataflow and DNN mapping on the mesh topology for decreasing delay and energy consumption. Simulation results show reducing the delay and energy consumption of training and inference phases by approximately 22.56%-77% and 65.94%-88.54% compared with not employing a DNN pruning.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] NI plus Router Microarchitecture for NoC-based Communication Systems
    Sandoval-Arechiga, R.
    Parra-Michel, R.
    Vazquez-Avila, J. L.
    Gea-Garcia, B. I.
    PROCEEDINGS OF THE 2016 SYMPOSIUM ON ARCHITECTURES FOR NETWORKING AND COMMUNICATIONS SYSTEMS (ANCS'16), 2016, : 131 - 132
  • [22] Trading-off System Load and Communication in Mapping Heuristics for Improving NoC-Based MPSoCs Reliability
    Mandelli, Marcelo
    Ost, Luciano
    Sassatelli, Gilles
    Moraes, Fernando
    PROCEEDINGS OF THE SIXTEENTH INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2015), 2015, : 387 - 391
  • [23] Contention-Aware Mapping and Scheduling Optimization for NoC-Based MPSoCs
    Zhou, Yupeng
    Yan, Rongjie
    Cai, Anyu
    Yan, Yige
    Yin, Minghao
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 13995 - 13996
  • [24] Dynamic Mapping of Quality Adjustable Applications on NoC-based Reconfigurable Platforms
    Nguyen Van Cuong
    Nguyen Trong Bang
    Le Dinh Tuyen
    Pham Ngoc Nam
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR COMMUNICATIONS (ATC), 2016, : 322 - 327
  • [25] HeterGenMap: An Evolutionary Mapping Framework for Heterogeneous NoC-Based Neuromorphic Systems
    Dang, Khanh N.
    Doan, Nguyen Anh Vu
    Nguyen, Ngo-Doanh
    Abdallah, Abderazek Ben
    IEEE ACCESS, 2023, 11 : 144095 - 144112
  • [26] HyDra: Hybrid Task Mapping Application Framework for NOC-Based MPSoCs
    Amin, Waqar
    Hussain, Fawad
    Anjum, Sheraz
    Saleem, Sharoon
    Ahmad, Waqar
    Hussain, Mubashir
    IEEE ACCESS, 2023, 11 : 52309 - 52326
  • [27] An effective scheduling and mapping algorithm of tasks for heterogeneous NoC-Based MPSoC
    Yang, Pengfei
    Wang, Quan
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2015, 49 (06): : 72 - 76
  • [28] Hierarchical and Dependency-Aware Task Mapping for NoC-based Systems
    Huang, Chun-Hsian
    Chen, Ching-Yen
    Huang, Hung-Yu
    2018 11TH INTERNATIONAL WORKSHOP ON NETWORK ON CHIP ARCHITECTURES (NOCARC), 2018, : 15 - 20
  • [29] Exploring Resource Mapping Policies for Dynamic Clustering on NoC-based MPSoCs
    Girao, Gustavo
    Santini, Thiago
    Wagner, Flavio R.
    DESIGN, AUTOMATION & TEST IN EUROPE, 2013, : 681 - 684
  • [30] Evaluation of Static and Dynamic Task Mapping Algorithms in NoC-Based MPSoCs
    Carvalho, Ewerson
    Marcon, Cesar
    Calazans, Ney
    Moraes, Fernando
    2009 INTERNATIONAL SYMPOSIUM ON SYSTEM-ON-CHIP PROCEEDINGS, 2009, : 87 - 90