A Survey of Knowledge Distillation in Deep Learning

被引：0
|
作者：
Shao, Ren-Rong [1 ]
Liu, Yu-Ang [1 ]
Zhang, Wei [1 ]
Wang, Jun [1 ]
机构：
[1] School of Computer Science and Technology, East China Normal University, Shanghai,200062, China
来源：
Jisuanji Xuebao/Chinese Journal of Computers | 2022年 / 45卷 / 08期
关键词：
276;
D O I：
10.11897/SP.J.1016.2022.01638
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：1638 / 1673
相关论文
共 50 条
  • [1] Knowledge distillation in deep learning and its applications
    Alkhulaifi, Abdolmaged
    Alsahli, Fahad
    Ahmad, Irfan
    [J]. PEERJ COMPUTER SCIENCE, 2021, PeerJ Inc. (07) : 1 - 24
  • [2] Improving Deep Mutual Learning via Knowledge Distillation
    Lukman, Achmad
    Yang, Chuan-Kai
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (15):
  • [3] Knowledge Distillation: A Survey
    Huang, Zhen-Hua
    Yang, Shun-Zhi
    Lin, Wei
    Ni, Juan
    Sun, Sheng-Li
    Chen, Yun-Wen
    Tang, Yong
    [J]. Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (03): : 624 - 653
  • [4] Knowledge Distillation: A Survey
    Gou, Jianping
    Yu, Baosheng
    Maybank, Stephen J.
    Tao, Dacheng
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (06) : 1789 - 1819
  • [5] Knowledge Distillation: A Survey
    Jianping Gou
    Baosheng Yu
    Stephen J. Maybank
    Dacheng Tao
    [J]. International Journal of Computer Vision, 2021, 129 : 1789 - 1819
  • [6] Knowledge Distillation with Attention for Deep Transfer Learning of Convolutional Networks
    Li, Xingjian
    Xiong, Haoyi
    Chen, Zeyu
    Huan, Jun
    Liu, Ji
    Xu, Cheng-Zhong
    Dou, Dejing
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2022, 16 (03)
  • [7] Refining Design Spaces in Knowledge Distillation for Deep Collaborative Learning
    Iwata, Sachi
    Minami, Soma
    Hirakawa, Tsubasa
    Yamashita, Takayoshi
    Fujiyoshi, Hironobu
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2371 - 2377
  • [8] A survey on deep learning based knowledge tracing
    Song, Xiangyu
    Li, Jianxin
    Cai, Taotao
    Yang, Shuiqiao
    Yang, Tingting
    Liu, Chengfei
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258
  • [9] Knowledge Distillation with Deep Supervision
    Luo, Shiya
    Chen, Defang
    Wang, Can
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [10] "In-Network Ensemble": Deep Ensemble Learning with Diversified Knowledge Distillation
    Li, Xingjian
    Xiong, Haoyi
    Chen, Zeyu
    Huan, Jun
    Xu, Cheng-Zhong
    Dou, Dejing
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2021, 12 (05)
12345