INFERENCE ACCELERATION OF DEEP LEARNING CLASSIFIERS BASED ON RNN

被引:0
|
作者
Keddous, Fekhr Eddine [1 ,2 ]
Shvai, Nadiya [2 ]
Llanza, Arcadi [1 ,2 ]
Nakib, Amir [1 ,2 ]
机构
[1] Univ Paris Est Creteil, Lab LISSI, Paris, France
[2] Cyclope Ai, Paris, France
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
Deep Neural Networks; Modern Hopfield Neural Networks; Image Classification; Convolutional Neural Networks; Associative Memory;
D O I
10.1109/ICIP49359.2023.10222316
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a hybrid strategy for accelerating image classification inference based on the Modern Continuous Hopfield Neural Network (MHNN). To implement this strategy, the fully connected layers of convolutional neural networks (CNNs) are replaced by the MHNN. The proposed hybrid architecture achieves promising results for image classification tasks, as demonstrated through experiments on multiple benchmark datasets, including ImageNet, and different CNN architectures. It offers a remarkable speedup in inference time (ranging from 1.12x to 1.6x) and significant compression in terms of the number of neural network parameters (ranging from 1.32x to 49.37x), while maintaining high accuracy. Furthermore, the proposed CNN-MHNN model achieves an accuracy of 99.18% on the Noisy MNIST dataset, outperforming state-of-the-art models with a 0.75% improvement for the Added White Gaussian Noise version.
引用
收藏
页码:2450 / 2454
页数:5
相关论文
共 50 条
  • [41] Privacy-enhanced deep learning inference acceleration towards third-party cloud based on trusted execution environment
    Yulong Wang
    Yubing Duan
    Jun Han
    Zhi Chen
    Mingyong Yin
    Guoxin Zhong
    Peer-to-Peer Networking and Applications, 2025, 18 (3)
  • [42] Hardware for Deep Learning Acceleration
    Song, Choongseok
    Ye, Changmin
    Sim, Yonguk
    Jeong, Doo Seok
    ADVANCED INTELLIGENT SYSTEMS, 2024, 6 (10)
  • [43] Deep Learning Architecture for Detecting SQL Injection Attacks Based on RNN Autoencoder Model
    Alghawazi, Maha
    Alghazzawi, Daniyal
    Alarifi, Suaad
    MATHEMATICS, 2023, 11 (15)
  • [44] Detection of fake news using deep learning CNN-RNN based methods
    Sastrawan, I. Kadek
    Bayupati, I. P. A.
    Arsa, Dewa Made Sri
    ICT EXPRESS, 2022, 8 (03): : 396 - 408
  • [45] SAE-RNN Deep Learning for RGB-D Based Object Recognition
    Bai, Jing
    Wu, Yan
    INTELLIGENT COMPUTING THEORY, 2014, 8588 : 235 - 240
  • [46] Deep Learning Type Inference
    Hellendoorn, Vincent J.
    Bird, Christian
    Barr, Earl T.
    Allamanis, Miltiadis
    ESEC/FSE'18: PROCEEDINGS OF THE 2018 26TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, 2018, : 152 - 162
  • [47] Enhanced CNN-RNN deep learning-based framework for the detection of glaucoma
    Veena, H. N.
    Muruganandham, A.
    Kumaran, T. Senthil
    INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2021, 36 (02) : 133 - 147
  • [48] MULTIPLE-TARGET DEEP LEARNING FOR LSTM-RNN BASED SPEECH ENHANCEMENT
    Sun, Lei
    Du, Jun
    Dai, Li-Rong
    Lee, Chin-Hui
    2017 HANDS-FREE SPEECH COMMUNICATIONS AND MICROPHONE ARRAYS (HSCMA 2017), 2017, : 136 - 140
  • [49] Acceleration-Based Deep Learning Method for Vehicle Monitoring
    Zhu, Yanjie
    Sekiya, Hidehiko
    Okatani, Takayuki
    Yoshida, Ikumasa
    Hirano, Shuichi
    IEEE SENSORS JOURNAL, 2021, 21 (15) : 17154 - 17161
  • [50] Deep Learning Acceleration Design Based on Low Rank Approximation
    Chang, Yi-Hsiang
    Lee, Gwo Giun
    Chen, Shiu-Yu
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 1304 - 1307