A computationally efficient scheme for feature extraction with kernel discriminant analysis

被引:20
|
作者
Min, Hwang-Ki [1 ]
Hou, Yuxi [1 ]
Park, Sangwoo [1 ]
Song, Iickho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Elect Engn, Daejeon 305701, South Korea
基金
新加坡国家研究基金会;
关键词
Kernel discriminant analysis; Computational complexity; Lagrange method; Regularization; Pattern recognition; COMPONENT ANALYSIS; RECOGNITION; IMPLEMENTATION;
D O I
10.1016/j.patcog.2015.08.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The kernel discriminant analysis (KDA), an extension of the linear discriminant analysis (LDA) and null space-based LDA into the kernel space, generally provides good pattern recognition (PR) performance for both small sample size (SSS) and non-SSS PR problems. Due to the eigen-decomposition technique adopted, however, the original scheme for the feature extraction with the KDA suffers from a high complexity burden. In this paper, we derive a transformation of the KDA into a linear equation problem, and propose a novel scheme for the feature extraction with the KDA. The proposed scheme is shown to provide us with a reduction of complexity without degradation of PR performance. In addition, to enhance the PR performance further, we address the incorporation of regularization into the proposed scheme. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:45 / 55
页数:11
相关论文
共 50 条
  • [41] A Novel Face Feature Extraction Method Based on Two-dimensional Principal Component Analysis and Kernel Discriminant Analysis
    Wang, Xiaoguo
    Liu, Jun
    Tian, Ming
    Huang, Yong
    Cao, Tieyong
    Zhang, Xiongwei
    2009 INTERNATIONAL CONFERENCE ON INFORMATION MANAGEMENT AND ENGINEERING, PROCEEDINGS, 2009, : 196 - 200
  • [42] Multiple Feature Point Discriminant Analysis and Its Application to Feature Extraction
    Yan, Lijun
    Li, Junbao
    Zhou, Ying
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS AND ELECTRICAL ENGINEERING TECHNOLOGY (EEET 2019), 2019, : 19 - 23
  • [43] Adaptive linear discriminant analysis for online feature extraction
    Ghassabeh, Youness Aliyari
    Moghaddam, Hamid Abrishami
    MACHINE VISION AND APPLICATIONS, 2013, 24 (04) : 777 - 794
  • [44] Feature extraction using nonparametric margin discriminant analysis
    Lin, Xiaochang
    Chen, Bilian
    Li, An
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 1013 - 1018
  • [45] Sparse margin–based discriminant analysis for feature extraction
    Zhenghong Gu
    Jian Yang
    Neural Computing and Applications, 2013, 23 : 1523 - 1529
  • [46] Adaptive linear discriminant analysis for online feature extraction
    Youness Aliyari Ghassabeh
    Hamid Abrishami Moghaddam
    Machine Vision and Applications, 2013, 24 : 777 - 794
  • [47] KPCA plus LDA: A complete kernel fisher discriminant framework for feature extraction and recognition
    Yang, J
    Frangi, AF
    Yang, JY
    Zhang, D
    Jin, Z
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (02) : 230 - 244
  • [48] Feature space locality constraint for kernel based nonlinear discriminant analysis
    Lei, Zhen
    Mang, Zhiwei
    Li, Stan Z.
    PATTERN RECOGNITION, 2012, 45 (07) : 2733 - 2742
  • [49] Sparse Feature Selection in Kernel Discriminant Analysis via Optimal Scoring
    Lapanowski, Alexander F.
    Gaynanova, Irina
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [50] An efficient and effective method to solve kernel - Fisher discriminant analysis
    Liang, ZZ
    Shi, PF
    NEUROCOMPUTING, 2004, 61 (1-4) : 485 - 493