A reproducing kernel Hilbert space approach to high dimensional partially varying coefficient model

被引:4
|
作者
Lv, Shaogao [1 ]
Fan, Zengyan [2 ]
Lian, Heng [3 ]
Suzuki, Taiji [4 ,5 ]
Fukumizu, Kenji [6 ]
机构
[1] Nanjing Audit Univ, Dept Stat & Math, Nanjing, Peoples R China
[2] Singapore Univ Social Sci, Sch Sci & Technol, Singapore, Singapore
[3] City Univ HongKong, Dept Math, Hong Kong, Peoples R China
[4] Univ Tokyo, Dept Math Informat, Tokyo, Japan
[5] RIKEN, Ctr Adv Intelligence Project, Wako, Saitama, Japan
[6] Inst Stat Math, Tokyo, Japan
基金
中国国家自然科学基金;
关键词
Varying coefficient models; Sparsity; Structure learning; High dimensions; Reproducing kernel Hilbert space (RKHS); ADDITIVE-MODELS; SPARSITY; CONSISTENCY; SELECTION; INEQUALITIES; REGRESSION; LASSO; RATES;
D O I
10.1016/j.csda.2020.107039
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Partially varying coefficient model (PVCM) provides a useful class of tools for modeling complex data by incorporating a combination of constant and time-varying covariate effects. One natural question is that how to decide which covariates correspond to constant coefficients and which correspond to time-dependent coefficient functions. To handle this two-type structure selection problem on PVCM, those existing methods are either based on a finite truncation way of coefficient functions, or based on a two-phase procedure to estimate the constant and function parts separately. This paper attempts to provide a complete theoretical characterization for estimation and structure selection issues of PVCM, via proposing two new penalized methods for PVCM within a reproducing kernel Hilbert space (RKHS). The proposed strategy is partially motivated by the so-called "Non-Constant Theorem" of radial kernels, which ensures a unique and unified representation of each candidate component in the hypothesis space. Within a high-dimensional framework, minimax convergence rates for the prediction risk of the first method is established when each unknown time-dependent coefficient can be well approximated within a specified RKHS. On the other hand, under certain regularity conditions, it is shown that the second proposed estimator is able to identify the underlying structure correctly with high probability. Several simulated experiments are implemented to examine the finite sample performance of the proposed methods. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:28
相关论文
共 50 条
  • [22] Sparse high-dimensional semi-nonparametric quantile regression in a reproducing kernel Hilbert space
    Wang, Yue
    Zhou, Yan
    Li, Rui
    Lian, Heng
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2022, 168
  • [23] Reproducing Kernel Hilbert Space Approach to Multiresponse Smoothing Spline Regression Function
    Lestari, Budi
    Chamidah, Nur
    Aydin, Dursun
    Yilmaz, Ersin
    [J]. SYMMETRY-BASEL, 2022, 14 (11):
  • [24] Computational inverse scattering with internal sources: A reproducing kernel Hilbert space approach
    Dong, Yakun
    Sadiq, Kamran
    Scherzer, Otmar
    Schotland, John C.
    [J]. Physical Review E, 110 (06):
  • [25] The reproducing kernel Hilbert space approach in nonparametric regression problems with correlated observations
    Benelmadani, D.
    Benhenni, K.
    Louhichi, S.
    [J]. ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2020, 72 (06) : 1479 - 1500
  • [26] The reproducing kernel Hilbert space approach in nonparametric regression problems with correlated observations
    D. Benelmadani
    K. Benhenni
    S. Louhichi
    [J]. Annals of the Institute of Statistical Mathematics, 2020, 72 : 1479 - 1500
  • [27] Partially functional linear regression in reproducing kernel Hilbert spaces
    Cui, Xia
    Lin, Hongmei
    Lian, Heng
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2020, 150
  • [28] Fast quantile regression in reproducing kernel Hilbert space
    Zheng, Songfeng
    [J]. JOURNAL OF THE KOREAN STATISTICAL SOCIETY, 2022, 51 (02) : 568 - 588
  • [29] Sampling Theory in Abstract Reproducing Kernel Hilbert Space
    Yoon Mi Hong
    Jong Min Kim
    Kil H. Kwon
    [J]. Sampling Theory in Signal and Image Processing, 2007, 6 (1): : 109 - 121
  • [30] Ensemble forecasts in reproducing kernel Hilbert space family
    Dufee, Benjamin
    Hug, Berenger
    Memin, Etienne
    Tissot, Gilles
    [J]. PHYSICA D-NONLINEAR PHENOMENA, 2024, 459