A new meta-criterion for regularized subspace information criterion

被引:0
|
作者
Hidaka, Yasushi [1 ]
Sugiyama, Masashi [1 ]
机构
[1] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
来源
关键词
supervised learning; generalization capability; model selection; unbiased estimator; regularized subspace information criterion;
D O I
10.1093/ietisy/e90-d.11.1779
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In order to obtain better generalization performance in supervised learning, model parameters should be determined appropriately, i.e., they should be determined so that the generalization error is minimized. However, since the generalization error is inaccessible in practice, the model parameters are usually determined so that an estimator of the generalization error is minimized. The regularized subspace information criterion (RSIC) is such a generalization error estimator for model selection. RSIC includes an additional regularization parameter and it should be determined appropriately for better model selection. A meta-criterion for determining the regularization parameter has also been proposed and shown to be useful in practice. In this paper, we show that there are several drawbacks in the existing meta-criterion and give an alternative meta-criterion that can solve the problems. Through simulations, we show that the use of the: new meta-criterion further improves the model selection performance.
引用
收藏
页码:1779 / 1786
页数:8
相关论文
共 50 条
  • [1] Analytic optimization of shrinkage parameters based on regularized subspace information criterion
    Sugiyama, Masashi
    Sakurai, Keisuke
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2006, E89A (08): : 2216 - 2225
  • [2] Analytic optimization of adaptive ridge parameters based on regularized subspace information criterion
    Gokita, Shun
    Sugiyama, Masashi
    Sakurai, Keisuke
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2007, E90A (11) : 2584 - 2592
  • [3] Improving precision of the subspace information criterion
    Sugiyama, M
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2003, E86A (07): : 1885 - 1895
  • [4] ε-Insensitive Modification of Subspace Information Criterion
    Zhou, Xuejun
    [J]. THIRD INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTING, 2009, : 188 - 191
  • [5] Subspace information criterion for model selection
    Sugiyama, M
    Ogawa, H
    [J]. NEURAL COMPUTATION, 2001, 13 (08) : 1863 - 1889
  • [6] A novel algorithm for signal subspace tracking based on a new subspace information criterion
    Valizadeh, Amir
    Mohammadian, Roozbeh
    Rafiei, Ali
    Rafati, Amirhossein
    [J]. 2007 6TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS & SIGNAL PROCESSING, VOLS 1-4, 2007, : 1141 - 1144
  • [7] Principal Subspace Tracking Information Criterion and Algorithm
    Gao Y.-B.
    Kong X.-Y.
    Cui Q.-H.
    Hou L.-A.
    [J]. Kong, Xiang-Yu (xiangyukong01@163.com), 1600, Science Press (46): : 2214 - 2220
  • [8] Theoretical and Experimental Evaluation of the Subspace Information Criterion
    Masashi Sugiyama
    Hidemitsu Ogawa
    [J]. Machine Learning, 2002, 48 : 25 - 50
  • [9] Theoretical and experimental evaluation of the subspace information criterion
    Sugiyama, M
    Ogawa, H
    [J]. MACHINE LEARNING, 2002, 48 (1-3) : 25 - 50
  • [10] Fast subspace tracking by a novel information criterion
    Miao, YF
    Hua, YB
    [J]. THIRTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, VOLS 1 AND 2, 1998, : 1312 - 1316