Ridge regression and its degrees of freedom

被引:0
|
作者
Theo K. Dijkstra
机构
[1] University of Groningen,Faculty of Economics & Business
来源
Quality & Quantity | 2014年 / 48卷
关键词
Ridge regression; Degrees of freedom; Prediction ; Cross-validation; Stein’s identity;
D O I
暂无
中图分类号
学科分类号
摘要
For ridge regression the degrees of freedom are commonly calculated by the trace of the matrix that transforms the vector of observations on the dependent variable into the ridge regression estimate of its expected value. For a fixed ridge parameter this is unobjectionable. When the ridge parameter is optimized on the same data, by minimization of the generalized cross validation criterion or Mallows CL\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\hbox {C}_{L}$$\end{document}, additional degrees of freedom are used however. We give formulae that take this into account. This allows of a proper assessment of ridge regression in competitions for the best predictor.
引用
收藏
页码:3185 / 3193
页数:8
相关论文
共 50 条
  • [1] Ridge regression and its degrees of freedom
    Dijkstra, Theo K.
    [J]. QUALITY & QUANTITY, 2014, 48 (06) : 3185 - 3193
  • [2] RIDGE-REGRESSION - DEGREES OF FREEDOM IN THE ANALYSIS OF VARIANCE
    HOERL, AE
    KENNARD, RW
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 1990, 19 (04) : 1485 - 1495
  • [3] Estimation of Three Degrees of Freedom of Wrist Movement from Electromyogram Using Kernel Ridge Regression
    Bakshi, Koushik
    Biswas, Satarupa
    Manjunatha, M.
    Kumar, C. S.
    [J]. 2017 8TH INTERNATIONAL IEEE/EMBS CONFERENCE ON NEURAL ENGINEERING (NER), 2017, : 130 - 133
  • [4] On the Degrees of Freedom of Mixed Matrix Regression
    Shang, Pan
    Kong, Lingchen
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2017, 2017
  • [5] Diversity and degrees of freedom in regression ensembles
    Reeve, Henry W. J.
    Brown, Gavin
    [J]. NEUROCOMPUTING, 2018, 298 : 55 - 68
  • [6] The Degrees of Freedom of Partial Least Squares Regression
    Kraemer, Nicole
    Sugiyama, Masashi
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2011, 106 (494) : 697 - 705
  • [7] On the degrees of freedom in shape-restricted regression
    Meyer, M
    Woodroofe, M
    [J]. ANNALS OF STATISTICS, 2000, 28 (04): : 1083 - 1104
  • [8] Calculating degrees of freedom in multivariate local polynomial regression
    McCloud, Nadine
    Parmeter, Christopher F.
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2021, 210 : 141 - 160
  • [9] SOME REMARKS ABOUT DEGREES OF FREEDOM IN REGRESSION PROBLEMS
    FERRARIS, GB
    [J]. CHEMICAL ENGINEERING SCIENCE, 1974, 29 (08) : 1827 - 1828
  • [10] Degrees of freedom for regularized regression with Huber loss and linear constraints
    Liu, Yongxin
    Zeng, Peng
    Lin, Lu
    [J]. STATISTICAL PAPERS, 2021, 62 (05) : 2383 - 2405