INFERENCE ACCELERATION OF DEEP LEARNING CLASSIFIERS BASED ON RNN

被引:0
|
作者
Keddous, Fekhr Eddine [1 ,2 ]
Shvai, Nadiya [2 ]
Llanza, Arcadi [1 ,2 ]
Nakib, Amir [1 ,2 ]
机构
[1] Univ Paris Est Creteil, Lab LISSI, Paris, France
[2] Cyclope Ai, Paris, France
关键词
Deep Neural Networks; Modern Hopfield Neural Networks; Image Classification; Convolutional Neural Networks; Associative Memory;
D O I
10.1109/ICIP49359.2023.10222316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a hybrid strategy for accelerating image classification inference based on the Modern Continuous Hopfield Neural Network (MHNN). To implement this strategy, the fully connected layers of convolutional neural networks (CNNs) are replaced by the MHNN. The proposed hybrid architecture achieves promising results for image classification tasks, as demonstrated through experiments on multiple benchmark datasets, including ImageNet, and different CNN architectures. It offers a remarkable speedup in inference time (ranging from 1.12x to 1.6x) and significant compression in terms of the number of neural network parameters (ranging from 1.32x to 49.37x), while maintaining high accuracy. Furthermore, the proposed CNN-MHNN model achieves an accuracy of 99.18% on the Noisy MNIST dataset, outperforming state-of-the-art models with a 0.75% improvement for the Added White Gaussian Noise version.
引用
收藏
页码:2450 / 2454
页数:5
相关论文
共 50 条
  • [1] Deep RNN Learning for EEG based Functional Brain State Inference
    Patnaik, Suprava
    Moharkar, Lalita
    Chaudhari, Amogh
    2017 IEEE INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND CONTROL (ICAC3), 2017,
  • [2] Laconic Deep Learning Inference Acceleration
    Sharify, Sayeh
    Lascorz, Alberto Delmas
    Mahmoud, Mostafa
    Nikolic, Milos
    Siu, Kevin
    Stuart, Dylan Malone
    Poulos, Zissis
    Moshovos, Andreas
    PROCEEDINGS OF THE 2019 46TH INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA '19), 2019, : 304 - 317
  • [3] Analysis of the acceleration of deep learning inference models on a heterogeneous architecture based on OpenVINO
    Guerrouj, Fatima Zahra
    Abouzahir, Mohamed
    Ramzi, Mustapha
    Abdali, El Mehdi
    2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [4] Membership Inference Attack and Defense for Wireless Signal Classifiers With Deep Learning
    Shi, Yi
    Sagduyu, Yalin E.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (07) : 4032 - 4043
  • [5] Research on Parallel Acceleration for Deep Learning Inference Based on Many-Core ARM Platform
    Zhu, Keqian
    Jiang, Jingfei
    ADVANCED COMPUTER ARCHITECTURE, 2018, 908 : 30 - 41
  • [6] DEEP LEARNING AMR MODEL INFERENCE ACCELERATION WITH CFU FOR EDGE SYSTEMS
    Hilei, Pavlo
    Petruk, Marian
    Korotkyi, Ievgen
    Farenyuk, Oleg
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 66 - 70
  • [7] Visual Analytics for RNN-Based Deep Reinforcement Learning
    Wang, Junpeng
    Zhang, Wei
    Yang, Hao
    Yeh, Chin-Chia Michael
    Wang, Liang
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (12) : 4141 - 4155
  • [8] A Hybrid RNN based Deep Learning Approach for Text Classification
    Sunagar, Pramod
    Kanavalli, Anita
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (06) : 289 - 295
  • [9] LEARNING DEEP CLASSIFIERS WITH DEEP FEATURES
    Lei, Jie
    Song, Xinhui
    Sun, Li
    Song, Mingli
    Li, Na
    Chen, Chun
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
  • [10] Distributed Deep Learning Inference Acceleration using Seamless Collaboration in Edge Computing
    Li, Nan
    Losifidis, Alexandros
    Zhang, Qi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 3667 - 3672