Uncertainty-based knowledge distillation for Bayesian deep neural network compression

被引：0
|
作者：
Hemmatian, Mina [1 ]
Shahzadi, Ali [1 ]
Mozaffari, Saeed [1 ,2 ]
机构：
[1] Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
[2] Department of Electrical and Computer Engineering, University of Windsor, ON, Canada
来源：
International Journal of Approximate Reasoning | 1600年 / 175卷
关键词：
Deep neural networks;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Journal article (JA)
引用
收藏
相关论文
共 50 条
  • [21] Uncertainty-Driven Knowledge Distillation for Language Model Compression
    Huang, Tianyu
    Dong, Weisheng
    Wu, Fangfang
    Li, Xin
    Shi, Guangming
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 2850 - 2858
  • [22] Knowledge Reverse Distillation Based Confidence Calibration for Deep Neural Networks
    Jiang, Xianhui
    Deng, Xiaogang
    NEURAL PROCESSING LETTERS, 2023, 55 (01) : 345 - 360
  • [23] Mitigating carbon footprint for knowledge distillation based deep learning model compression
    Rafat, Kazi
    Islam, Sadia
    Mahfug, Abdullah Al
    Hossain, Md. Ismail
    Rahman, Fuad
    Momen, Sifat
    Rahman, Shafin
    Mohammed, Nabeel
    PLOS ONE, 2023, 18 (05):
  • [24] Knowledge Reverse Distillation Based Confidence Calibration for Deep Neural Networks
    Xianhui Jiang
    Xiaogang Deng
    Neural Processing Letters, 2023, 55 : 345 - 360
  • [25] Feature Distribution-based Knowledge Distillation for Deep Neural Networks
    Hong, Hyeonseok
    Kim, Hyun
    2022 19TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2022, : 75 - 76
  • [26] Uncertainty-based prediction of work zone capacity using a Bayesian approach
    Weng, Jinxian
    Yu, Yao
    Ma, Lu
    PROCEEDINGS OF THE INSTITUTION OF CIVIL ENGINEERS-TRANSPORT, 2019, 172 (01) : 24 - 35
  • [27] Uncertainty-based saltwater intrusion prediction using integrated Bayesian machine learning modeling (IBMLM) in a deep aquifer
    Yin, Jina
    Huang, Yulu
    Lu, Chunhui
    Liu, Zhu
    JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 354
  • [28] Few Sample Knowledge Distillation for Efficient Network Compression
    Li, Tianhong
    Li, Jianguo
    Liu, Zhuang
    Zhang, Changshui
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 14627 - 14635
  • [29] Scalable Spintronics-based Bayesian Neural Network for Uncertainty Estimation
    Ahmed, Soyed Tuhin
    Danouchi, Kamal
    Hefenbrock, Michael
    Prenat, Guillaume
    Anghel, Lorena
    Tahoori, Mehdi B.
    2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [30] Compressing medical deep neural network models for edge devices using knowledge distillation
    Alabbasy, F. MohiEldeen
    Abohamama, A. S.
    Alabbasy, Mohieldeen
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (07)
12345