Kernel transform learning

被引:19
|
作者
Maggu, Jyoti [1 ]
Majumdar, Angshul [1 ]
机构
[1] Indraprastha Inst Informat Technol, Okhla Phase 3, New Delhi 110020, India
关键词
Transform learning; Dictionary learning; Kernel trick; K-SVD; DICTIONARY; ALGORITHM;
D O I
10.1016/j.patrec.2017.09.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work proposes kernel transform learning. The idea of dictionary learning is well known; it is a synthesis formulation where a basis is learnt along with the coefficients so as to generate/ synthesize the data. Transform learning is its analysis equivalent; the transforms operates/ analyses on the data to generate the coefficients. The concept of kernel dictionary learning has been introduced in the recent past, where the dictionary is represented as a linear combination of non-linear version of the data. Its success has been showcased in feature extraction. In this work we propose to kernelize transform learning on line similar to kernel dictionary learning. An efficient solution for kernel transform learning has been proposed -especially for problems where the number of samples is much larger than the dimensionality of the input samples making the kernel matrix very high dimensional. Kernel transform learning has been compared with other representation learning tools like autoencoder, restricted Boltzmann machine as well as with dictionary learning (and its kernelized version). Our proposed kernel transform learning yields better results than all the aforesaid techniques; experiments have been carried out on benchmark databases. (C) 2017 Elsevier B. V. All rights reserved.
引用
收藏
页码:117 / 122
页数:6
相关论文
共 50 条
  • [41] REGULARIZATION IN KERNEL LEARNING
    Mendelson, Shahar
    Neeman, Joseph
    ANNALS OF STATISTICS, 2010, 38 (01): : 526 - 565
  • [42] Deep Kernel Learning
    Wilson, Andrew Gordon
    Hu, Zhiting
    Salakhutdinov, Ruslan
    Xing, Eric P.
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 51, 2016, 51 : 370 - 378
  • [43] Fourier Kernel Learning
    Bazavan, Eduard Gabriel
    Li, Fuxin
    Sminchisescu, Cristian
    COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 : 459 - 473
  • [44] Implicit Kernel Learning
    Li, Chun-Liang
    Chang, Wei-Cheng
    Mroueh, Youssef
    Yang, Yiming
    Poczos, Barnabas
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [45] Composite kernel learning
    Szafranski, Marie
    Grandvalet, Yves
    Rakotomamonjy, Alain
    MACHINE LEARNING, 2010, 79 (1-2) : 73 - 103
  • [46] Learning the kernel with hyperkernels
    Ong, CS
    Smola, AJ
    Williamson, RC
    JOURNAL OF MACHINE LEARNING RESEARCH, 2005, 6 : 1043 - 1071
  • [47] KERNEL DICTIONARY LEARNING
    Hien Van Nguyen
    Patel, Vishal M.
    Nasrabadi, Nasser M.
    Chellappa, Rama
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 2021 - 2024
  • [48] Joint Learning of Distance Metric and Kernel Classifier via Multiple Kernel Learning
    Zhang, Weiqi
    Yan, Zifei
    Zhang, Hongzhi
    Zuo, Wangmeng
    PATTERN RECOGNITION (CCPR 2016), PT I, 2016, 662 : 586 - 600
  • [49] Automatic recognition of cognitive fatigue from physiological indices by using wavelet packet transform and kernel learning algorithms
    Zhang, Chong
    Zheng, Chong-Xun
    Yu, Xiao-Lin
    EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (03) : 4664 - 4671
  • [50] Multiple kernel learning with hybrid kernel alignment maximization
    Wang, Yueqing
    Liu, Xinwang
    Dou, Yong
    Lv, Qi
    Lu, Yao
    PATTERN RECOGNITION, 2017, 70 : 104 - 111