Enhancement of Knowledge Distillation via Non-Linear Feature Alignment

被引：0
|
作者：
Feng Jiangxiao Zhang
Lina Gao
Hongliang Huo
Ying Wang
机构：
[1] Mathematics and Information Technology Institute,
[2] Xingtai University,undefined
[3] Shijiazhuang Vocational Technology Institute,undefined
[4] Public Education Department,undefined
[5] Xingtai Medical College,undefined
来源：
Optical Memory and Neural Networks | 2023年 / 32卷
关键词：
knowledge distillation; image classification; knowledge transfer; deep learning;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：310 / 317
页数：7
相关论文
共 50 条
  • [1] Enhancement of Knowledge Distillation via Non-Linear Feature Alignment
    Zhang, Jiangxiao
    Gao, Feng
    Huo, Lina
    Wang, Hongliang
    Dang, Ying
    [J]. OPTICAL MEMORY AND NEURAL NETWORKS, 2023, 32 (04) : 310 - 317
  • [2] Implicit Feature Alignment For Knowledge Distillation
    Chen, Dingyao
    Wang, Mengzhu
    Zhang, Xiang
    Liang, Tianyi
    Luo, Zhigang
    [J]. 2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 402 - 408
  • [3] Knowledge Distillation with Feature Enhancement Mask
    Xiao, Yue
    Wang, Longye
    Li, Wentao
    Zeng, Xiaoli
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VIII, 2023, 14261 : 432 - 443
  • [4] Non-Linear Filtering for Feature Enhancement of Reverberant Speech
    Verma, Amit Kumar
    Tomar, Hemendra
    Chetupalli, Srikanth Raj
    Sreenivas, T. V.
    [J]. TENCON 2017 - 2017 IEEE REGION 10 CONFERENCE, 2017, : 1800 - 1805
  • [5] SELF-KNOWLEDGE DISTILLATION VIA FEATURE ENHANCEMENT FOR SPEAKER VERIFICATION
    Liu, Bei
    Wang, Haoyu
    Chen, Zhengyang
    Wang, Shuai
    Qian, Yanmin
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7542 - 7546
  • [6] Feature visibility limits in the non-linear enhancement of turbid images
    Jobson, DJ
    Rahman, ZU
    Woodell, GA
    [J]. VISUAL INFORMATION PROCESSING XII, 2003, 5108 : 24 - 30
  • [7] Local non-linear alignment for non-linear dimensionality reduction
    Niu, Guo
    Ma, Zhengming
    [J]. IET COMPUTER VISION, 2017, 11 (05) : 331 - 341
  • [8] Knowledge distillation via Noisy Feature Reconstruction
    Shi, Chaokun
    Hao, Yuexing
    Li, Gongyan
    Xu, Shaoyun
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 257
  • [9] Dual-Level Knowledge Distillation via Knowledge Alignment and Correlation
    Ding, Fei
    Yang, Yin
    Hu, Hongxin
    Krovi, Venkat
    Luo, Feng
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 2425 - 2435
  • [10] Non-linear predictive control for a distillation column
    Rueda, A.
    Cristea, S.
    de Prada, C.
    De Keyser, R.
    [J]. 2005 44th IEEE Conference on Decision and Control & European Control Conference, Vols 1-8, 2005, : 5156 - 5161
12345