INFERENCE ACCELERATION OF DEEP LEARNING CLASSIFIERS BASED ON RNN

被引:0
|
作者
Keddous, Fekhr Eddine [1 ,2 ]
Shvai, Nadiya [2 ]
Llanza, Arcadi [1 ,2 ]
Nakib, Amir [1 ,2 ]
机构
[1] Univ Paris Est Creteil, Lab LISSI, Paris, France
[2] Cyclope Ai, Paris, France
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
Deep Neural Networks; Modern Hopfield Neural Networks; Image Classification; Convolutional Neural Networks; Associative Memory;
D O I
10.1109/ICIP49359.2023.10222316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a hybrid strategy for accelerating image classification inference based on the Modern Continuous Hopfield Neural Network (MHNN). To implement this strategy, the fully connected layers of convolutional neural networks (CNNs) are replaced by the MHNN. The proposed hybrid architecture achieves promising results for image classification tasks, as demonstrated through experiments on multiple benchmark datasets, including ImageNet, and different CNN architectures. It offers a remarkable speedup in inference time (ranging from 1.12x to 1.6x) and significant compression in terms of the number of neural network parameters (ranging from 1.32x to 49.37x), while maintaining high accuracy. Furthermore, the proposed CNN-MHNN model achieves an accuracy of 99.18% on the Noisy MNIST dataset, outperforming state-of-the-art models with a 0.75% improvement for the Added White Gaussian Noise version.
引用
收藏
页码:2450 / 2454
页数:5
相关论文
共 50 条
  • [21] A MIC-BASED ACCELERATION MODEL OF DEEP LEARNING
    Zhang, Jianlei
    Zheng, Xumin
    Shen, Wenfeng
    Zhou, Dingqian
    Qiu, Feng
    Zhang, Huiran
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2016, : 608 - 614
  • [22] Value-Based Deep-Learning Acceleration
    Moshovos, Andreas
    Albericio, Jorge
    Judd, Patrick
    Lascorz, Alberto Delmas
    Sharify, Sayeh
    Hetherington, Tayler
    Aamodt, Tor
    Jerger, Natalie Enright
    IEEE MICRO, 2018, 38 (01) : 41 - 55
  • [23] Deep Learning Based Prediction on Greenhouse Crop Yield Combined TCN and RNN
    Gong, Liyun
    Yu, Miao
    Jiang, Shouyong
    Cutsuridis, Vassilis
    Pearson, Simon
    SENSORS, 2021, 21 (13)
  • [24] Optimal trade strategy based on RNN-LSTM deep learning method
    Sun, Chengjin
    Wang, Songyu
    Song, Qianrui
    Zhu, Shuai
    Heng, Jun
    Lei, Lijuan
    2ND INTERNATIONAL CONFERENCE ON APPLIED MATHEMATICS, MODELLING, AND INTELLIGENT COMPUTING (CAMMIC 2022), 2022, 12259
  • [25] DeepCPU: Serving RNN-based Deep Learning Models lOx Faster
    Zhang, Minjia
    Rajbhandari, Samyam
    Wang, Wenhan
    He, Yuxiong
    PROCEEDINGS OF THE 2018 USENIX ANNUAL TECHNICAL CONFERENCE, 2018, : 951 - 965
  • [26] A Modified RNN-Based Deep Learning Method for Prediction of Atmospheric Visibility
    Zang, Zengliang
    Bao, Xulun
    Li, Yi
    Qu, Youming
    Niu, Dan
    Liu, Ning
    Chen, Xisong
    REMOTE SENSING, 2023, 15 (03)
  • [27] Dynamic RNN-CNN based Malware Classifier for Deep Learning Algorithm
    Cho, Youngbok
    2019 29TH INTERNATIONAL TELECOMMUNICATION NETWORKS AND APPLICATIONS CONFERENCE (ITNAC), 2019,
  • [28] Efficient Deep Learning Inference based on Model Compression
    Zhang, Qing
    Zhang, Mengru
    Wang, Mengdi
    Sui, Wanchen
    Meng, Chen
    Yang, Jun
    Kong, Weidan
    Cui, Xiaoyuan
    Lin, Wei
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1776 - 1783
  • [29] Deep Learning based Scalable Inference of Uncertain Opinions
    Zhao, Xujiang
    Chen, Feng
    Cho, Jin-Hee
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 807 - 816
  • [30] Deep Spike Learning With Local Classifiers
    Ma, Chenxiang
    Yan, Rui
    Yu, Zhaofei
    Yu, Qiang
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (05) : 3363 - 3375