Uncertainty-based knowledge distillation for Bayesian deep neural network compression

被引:0
|
作者
Hemmatian, Mina [1 ]
Shahzadi, Ali [1 ]
Mozaffari, Saeed [1 ,2 ]
机构
[1] Faculty of Electrical and Computer Engineering, Semnan University, Semnan, Iran
[2] Department of Electrical and Computer Engineering, University of Windsor, ON, Canada
关键词
Deep neural networks;
D O I
暂无
中图分类号
学科分类号
摘要
Journal article (JA)
引用
收藏
相关论文
共 50 条
  • [41] Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks
    Vadera, Meet P.
    Jalain, Brian
    Marlin, Benjamin M.
    CONFERENCE ON UNCERTAINTY IN ARTIFICIAL INTELLIGENCE (UAI 2020), 2020, 124 : 719 - 728
  • [42] Universal Deep Neural Network Compression
    Choi, Yoojin
    El-Khamy, Mostafa
    Lee, Jungwon
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (04) : 715 - 726
  • [43] Knowledge Distillation for Optimization of Quantized Deep Neural Networks
    Shin, Sungho
    Boo, Yoonho
    Sung, Wonyong
    2020 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2020, : 111 - 116
  • [44] Improving the Interpretability of Deep Neural Networks with Knowledge Distillation
    Liu, Xuan
    Wang, Xiaoguang
    Matwin, Stan
    2018 18TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW), 2018, : 905 - 912
  • [45] Geometric Knowledge Distillation: Topology Compression for Graph Neural Networks
    Yang, Chenxiao
    Wu, Qitian
    Yan, Junchi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [46] Bayesian Nested Neural Networks for Uncertainty Calibration and Adaptive Compression
    Cui, Yufei
    Liu, Ziquan
    Li, Qiao
    Chan, Antoni B.
    Xue, Chun Jason
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2392 - 2401
  • [47] Assessment of knowledge based system uncertainty through Bayesian belief network modeling
    Kuprenas, JA
    COMPUTING IN CIVIL ENGINEERING, 1998, : 742 - 751
  • [48] Uncertainty-based reliability analysis of cutters via improved Bayesian prior distribution
    Cheng, Taotao
    Wang, Xu
    Liu, Xintian
    Wang, Jingang
    TRANSACTIONS OF THE CANADIAN SOCIETY FOR MECHANICAL ENGINEERING, 2025,
  • [49] A knowledge distillation-based deep interaction compressed network for CTR prediction
    Guan, Fei
    Qian, Cheng
    He, Feiyan
    KNOWLEDGE-BASED SYSTEMS, 2023, 275
  • [50] Lightweight Road Traffic Sign Identification Neural Network Based on Knowledge Distillation
    Ge, Yiyuan
    Yu, Mingxin
    Computer Engineering and Applications, 2024, 60 (19) : 110 - 119