Bilinear analysis for Kernel selection and nonlinear feature extraction

被引:29
|
作者
Yang, Shu [1 ]
Yan, Shuicheng
Zhang, Chao
Tang, Xiaoou
机构
[1] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
[2] Univ Illinois, Beckman Inst, Urbana, IL 61801 USA
[3] Peking Univ, Natl Lab Machine Percept, Beijing 100871, Peoples R China
[4] Microsoft Res Asia, Visual Comp Grp, Beijing, Peoples R China
[5] Chinese Univ Hong Kong, Dept Informat Engn, Shatin, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 05期
基金
中国国家自然科学基金;
关键词
bilinear analysis; discriminant analysis; face recognition; feature extraction; Fisher criterion; kernel selection;
D O I
10.1109/TNN.2007.894042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a unified criterion, Fisher + kernel criterion (FKC), for feature extraction and recognition. This new criterion is intended to extract the most discriminant features in different nonlinear spaces, and then, fuse these features under a unified measurement. Thus, FKC can simultaneously achieve nonlinear discriminant analysis and kernel selection. In addition, we present an efficient algorithm Fisher + kernel analysis (FKA), which utilizes the bilinear analysis, to optimize the new criterion. This FKA algorithm can alleviate the ill-posed problem existed in traditional kernel discriminant analysis (KDA), and usually, has no singularity problem. The effectiveness of our proposed algorithm is validated by a series of face-recognition experiments on several different databases.
引用
收藏
页码:1442 / 1452
页数:11
相关论文
共 50 条
  • [1] A Subspace Kernel for Nonlinear Feature Extraction
    Wu, Mingrui
    Farquhar, Jason
    [J]. 20TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2007, : 1125 - 1130
  • [2] Bilinear discriminant feature line analysis for image feature extraction
    Yan, Lijun
    Li, Jun-Bao
    Zhu, Xiaorui
    Pan, Jeng-Shyang
    Tang, Linlin
    [J]. ELECTRONICS LETTERS, 2015, 51 (04) : 336 - 337
  • [3] Nonlinear feature extraction based on centroids and kernel functions
    Park, CH
    Park, H
    [J]. PATTERN RECOGNITION, 2004, 37 (04) : 801 - 810
  • [4] Modified kernel-based nonlinear feature extraction
    Dai, G
    Qian, YT
    Jia, S
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL V, PROCEEDINGS: DESIGN AND IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS INDUSTRY TECHNOLOGY TRACKS MACHINE LEARNING FOR SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING SIGNAL PROCESSING FOR EDUCATION, 2004, : 721 - 724
  • [5] Reformative nonlinear feature extraction using kernel MSE
    Zhu, Qi
    [J]. NEUROCOMPUTING, 2010, 73 (16-18) : 3334 - 3337
  • [6] Nonlinear feature extraction and classification of multivariate process data in kernel feature space
    Cho, Hyun-Woo
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2007, 32 (02) : 534 - 542
  • [7] A Review of Kernel Methods for Feature Extraction in Nonlinear Process Monitoring
    Pilario, Karl Ezra
    Shafiee, Mahmood
    Cao, Yi
    Lao, Liyun
    Yang, Shuang-Hua
    [J]. PROCESSES, 2020, 8 (01)
  • [8] An MRF-based kernel method for nonlinear feature extraction
    Hsieh, Pi-Fuei
    Chou, Po-Wen
    Chung, Hsueh-Yi
    [J]. IMAGE AND VISION COMPUTING, 2010, 28 (03) : 502 - 517
  • [9] Feature selection based on kernel discriminant analysis
    Ashihara, Masamichi
    Abe, Shigeo
    [J]. ARTIFICIAL NEURAL NETWORKS - ICANN 2006, PT 2, 2006, 4132 : 282 - 291
  • [10] Kernel discriminant analysis based feature selection
    Ishii, Tsuneyoshi
    Ashihara, Masamichi
    Abe, Shigeo
    [J]. NEUROCOMPUTING, 2008, 71 (13-15) : 2544 - 2552