A new meta-criterion for regularized subspace information criterion

被引:0
|
作者
Hidaka, Yasushi [1 ]
Sugiyama, Masashi [1 ]
机构
[1] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
来源
关键词
supervised learning; generalization capability; model selection; unbiased estimator; regularized subspace information criterion;
D O I
10.1093/ietisy/e90-d.11.1779
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In order to obtain better generalization performance in supervised learning, model parameters should be determined appropriately, i.e., they should be determined so that the generalization error is minimized. However, since the generalization error is inaccessible in practice, the model parameters are usually determined so that an estimator of the generalization error is minimized. The regularized subspace information criterion (RSIC) is such a generalization error estimator for model selection. RSIC includes an additional regularization parameter and it should be determined appropriately for better model selection. A meta-criterion for determining the regularization parameter has also been proposed and shown to be useful in practice. In this paper, we show that there are several drawbacks in the existing meta-criterion and give an alternative meta-criterion that can solve the problems. Through simulations, we show that the use of the: new meta-criterion further improves the model selection performance.
引用
收藏
页码:1779 / 1786
页数:8
相关论文
共 50 条
  • [21] Insensitive Modification of Subspace Information Criterion for Least Mean Squares Learning
    Zhou, Xuejun
    [J]. 2013 SIXTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2013, : 428 - 430
  • [22] Multi-channel subspace mapping using an information maximization criterion
    Al-Ani, A
    Deriche, M
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2004, 15 (02) : 117 - 145
  • [23] Fast subspace tracking and neural network learning by a novel information criterion
    Miao, YF
    Hua, YB
    [J]. PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-6, 1998, : 1197 - 1200
  • [24] Optimal design of regularization term and regularization parameter by subspace information criterion
    Sugiyama, M
    Ogawa, H
    [J]. NEURAL NETWORKS, 2002, 15 (03) : 349 - 361
  • [25] Multi-Channel Subspace Mapping Using an Information Maximization Criterion
    Ahmed Al-Ani
    Mohamed Deriche
    [J]. Multidimensional Systems and Signal Processing, 2004, 15 : 117 - 145
  • [26] The Information Criterion
    Ghahramani, M.
    [J]. JOURNAL OF MODERN APPLIED STATISTICAL METHODS, 2014, 13 (02) : 444 - 454
  • [27] Marker selection by Akaike information criterion and Bayesian information criterion
    Li, WT
    Nyholt, DR
    [J]. GENETIC EPIDEMIOLOGY, 2001, 21 : S272 - S277
  • [28] Multimodel adaptive subtraction with regularized parameter selection via generalized information criterion
    Liu, Kuang-Hung
    Kostov, Clement
    [J]. GEOPHYSICS, 2015, 80 (03) : V33 - V45
  • [29] The proportion of dairy cows making a profit - meta-criterion for identifying economic and animal welfare-relevant needs for action
    Sundrum, Albert
    Habel, Jonas
    Hoischen-Taubner, Susanne
    Schwabenbauer, Eva-Marie
    Uhlig, Verena
    Moeller, Detlev
    [J]. BERICHTE UBER LANDWIRTSCHAFT, 2021, 99 (02):
  • [30] A regularized robust design criterion for uncertain data
    Sayed, AH
    Nascimento, VH
    Cipparrone, FAM
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2002, 23 (04) : 1120 - 1142