A computationally efficient scheme for feature extraction with kernel discriminant analysis

被引:20
|
作者
Min, Hwang-Ki [1 ]
Hou, Yuxi [1 ]
Park, Sangwoo [1 ]
Song, Iickho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Elect Engn, Daejeon 305701, South Korea
基金
新加坡国家研究基金会;
关键词
Kernel discriminant analysis; Computational complexity; Lagrange method; Regularization; Pattern recognition; COMPONENT ANALYSIS; RECOGNITION; IMPLEMENTATION;
D O I
10.1016/j.patcog.2015.08.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The kernel discriminant analysis (KDA), an extension of the linear discriminant analysis (LDA) and null space-based LDA into the kernel space, generally provides good pattern recognition (PR) performance for both small sample size (SSS) and non-SSS PR problems. Due to the eigen-decomposition technique adopted, however, the original scheme for the feature extraction with the KDA suffers from a high complexity burden. In this paper, we derive a transformation of the KDA into a linear equation problem, and propose a novel scheme for the feature extraction with the KDA. The proposed scheme is shown to provide us with a reduction of complexity without degradation of PR performance. In addition, to enhance the PR performance further, we address the incorporation of regularization into the proposed scheme. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:45 / 55
页数:11
相关论文
共 50 条
  • [1] Approximate information discriminant analysis: A computationally simple heteroscedastic feature extraction technique
    Das, Koel
    Nenadic, Zoran
    PATTERN RECOGNITION, 2008, 41 (05) : 1548 - 1557
  • [2] Data-dependent kernel discriminant analysis for feature extraction and classification
    Li, Jun-Bao
    Pan, Jeng-Shyang
    Lu, Zhe-Ming
    Liao, Bin-Yih
    2006 IEEE INTERNATIONAL CONFERENCE ON INFORMATION ACQUISITION, VOLS 1 AND 2, CONFERENCE PROCEEDINGS, 2006, : 1263 - 1268
  • [3] Kernel Fisher Discriminant Analysis with Locality Preserving for Feature Extraction and Recognition
    Di Zhang
    Jiazhong He
    Yun Zhao
    International Journal of Computational Intelligence Systems, 2013, 6 : 1059 - 1071
  • [4] Robust kernel discriminant analysis and its application to feature extraction and recognition
    Liang, ZZ
    Zhang, D
    Shi, PF
    NEUROCOMPUTING, 2006, 69 (7-9) : 928 - 933
  • [5] Kernel Fisher Discriminant Analysis with Locality Preserving for Feature Extraction and Recognition
    Zhang, Di
    He, Jiazhong
    Zhao, Yun
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2013, 6 (06) : 1059 - 1071
  • [6] Complexity-Reduced Scheme for Feature Extraction With Linear Discriminant Analysis
    Hou, Yuxi
    Song, Iickho
    Min, Hwang-Ki
    Park, Cheol Hoon
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (06) : 1003 - 1009
  • [7] Efficient feature extraction based on Regularized Uncorrelated Chernoff Discriminant Analysis
    Qin, A. K.
    Suganthan, P. N.
    Loog, M.
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS, 2006, : 125 - +
  • [8] Feature selection based on kernel discriminant analysis
    Ashihara, Masamichi
    Abe, Shigeo
    ARTIFICIAL NEURAL NETWORKS - ICANN 2006, PT 2, 2006, 4132 : 282 - 291
  • [9] Kernel discriminant analysis based feature selection
    Ishii, Tsuneyoshi
    Ashihara, Masamichi
    Abe, Shigeo
    NEUROCOMPUTING, 2008, 71 (13-15) : 2544 - 2552
  • [10] An efficient kernel discriminant analysis method
    Lu, JW
    Plataniotis, KN
    Venetsanopoulos, A
    Wang, J
    PATTERN RECOGNITION, 2005, 38 (10) : 1788 - 1790