Sparse estimation in functional linear regression

被引:32
|
作者
Lee, Eun Ryung [1 ]
Park, Byeong U. [1 ]
机构
[1] Seoul Natl Univ, Dept Stat, Seoul 151, South Korea
关键词
Functional data analysis; Functional principal component analysis; Karhunen-Loeve expansion; Sparsity; Adaptive LASSO; SCAD; MCP; Oracle properties; Penalized least squares regression; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; ORACLE PROPERTIES; MODEL SELECTION; LEAST-SQUARES; LASSO; ASYMPTOTICS; PREDICTION; SHRINKAGE; SPACE;
D O I
10.1016/j.jmva.2011.08.005
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
As a useful tool in functional data analysis, the functional linear regression model has become increasingly common and been studied extensively in recent years. In this paper, we consider a sparse functional linear regression model which is generated by a finite number of basis functions in an expansion of the coefficient function. In this model, we do not specify how many and which basis functions enter the model, thus it is not like a typical parametric model where predictor variables are pre-specified. We study a general framework that gives various procedures which are successful in identifying the basis functions that enter the model, and also estimating the resulting regression coefficients in one-step. We adopt the idea of variable selection in the linear regression setting where one adds a weighted L-1 penalty to the traditional least squares criterion. We show that the procedures in our general framework are consistent in the sense of selecting the model correctly, and that they enjoy the oracle property, meaning that the resulting estimators of the coefficient function have asymptotically the same properties as the oracle estimator which uses knowledge of the underlying model. We investigate and compare several methods within our general framework, via a simulation study. Also, we apply the methods to the Canadian weather data. (C) 2011 Elsevier Inc. All rights reserved.
引用
收藏
页码:1 / 17
页数:17
相关论文
共 50 条
  • [1] Optimal estimation in functional linear regression for sparse noise-contaminated data
    Mostafaiy, Behdad
    Faridrohani, MohammadReza
    Chenouri, Shojaeddin
    [J]. CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2019, 47 (04): : 524 - 559
  • [2] Smooth and locally sparse estimation for multiple-output functional linear regression
    Fang, Kuangnan
    Zhang, Xiaochen
    Ma, Shuangge
    Zhang, Qingzhao
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2020, 90 (02) : 341 - 354
  • [3] ESTIMATION IN FUNCTIONAL LINEAR QUANTILE REGRESSION
    Kato, Kengo
    [J]. ANNALS OF STATISTICS, 2012, 40 (06): : 3108 - 3136
  • [4] Remodeling and Estimation for Sparse Partially Linear Regression Models
    Zeng, Yunhui
    Wang, Xiuli
    Lin, Lu
    [J]. ABSTRACT AND APPLIED ANALYSIS, 2013,
  • [5] Bayesian Functional Linear Regression with Sparse Step Functions
    Grollemund, Paul-Marie
    Abraham, Christophe
    Baragatti, Meili
    Pudlo, Pierre
    [J]. BAYESIAN ANALYSIS, 2019, 14 (01): : 111 - 135
  • [6] Locally Sparse Estimator for Functional Linear Regression Models
    Lin, Zhenhua
    Cao, Jiguo
    Wang, Liangliang
    Wang, Haonan
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2017, 26 (02) : 306 - 318
  • [7] Sparse Functional Linear Regression with Applications to Personalized Medicine
    McKeague, Ian W.
    Qian, Min
    [J]. RECENT ADVANCES IN FUNCTIONAL DATA ANALYSIS AND RELATED TOPICS, 2011, : 213 - 218
  • [8] Distributed estimation of functional linear regression with functional responses
    Liu, Jiamin
    Li, Rui
    Lian, Heng
    [J]. METRIKA, 2024, 87 (01) : 21 - 30
  • [9] Distributed estimation of functional linear regression with functional responses
    Jiamin Liu
    Rui Li
    Heng Lian
    [J]. Metrika, 2024, 87 : 21 - 30
  • [10] Functional linear regression for functional response via sparse basis selection
    Han, Kyunghee
    Shin, Hyejin
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2015, 44 (03) : 376 - 389