Variable selection in linear-circular regression models

被引:1
|
作者
Camli, Onur [1 ]
Kalaylioglu, Zeynep [1 ]
SenGupta, Ashis [2 ]
机构
[1] Middle East Tech Univ, Dept Stat, Ankara, Turkey
[2] Indian Stat Inst, Appl Stat Unit, Kolkata, India
关键词
Regularization; Bayesian lasso; laplace distribution; circular regression; dimension reduction; TUNING PARAMETER SELECTION; BAYESIAN-ANALYSIS; SHRINKAGE; LASSO; DISTRIBUTIONS;
D O I
10.1080/02664763.2022.2110860
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Applications of circular regression models are ubiquitous in many disciplines, particularly in meteorology, biology and geology. In circular regression models, variable selection problem continues to be a remarkable open question. In this paper, we address variable selection in linear-circular regression models where uni-variate linear dependent and a mixed set of circular and linear independent variables constitute the data set. We consider Bayesian lasso which is a popular choice for variable selection in classical linear regression models. We show that Bayesian lasso in linear-circular regression models is not able to produce robust inference as the coefficient estimates are sensitive to the choice of hyper-prior setting for the tuning parameter. To eradicate the problem, we propose a robustified Bayesian lasso that is based on an empirical Bayes (EB) type methodology to construct a hyper-prior for the tuning parameter while using Gibbs Sampling. This hyper-prior construction is computationally more feasible than the hyper-priors that are based on correlation measures. We show in a comprehensive simulation study that Bayesian lasso with EB-GS hyper-prior leads to a more robust inference. Overall, the method offers an efficient Bayesian lasso for variable selection in linear-circular regression while reducing model complexity.
引用
收藏
页码:3337 / 3361
页数:25
相关论文
共 50 条
  • [21] INFERENCE AFTER VARIABLE SELECTION IN LINEAR-REGRESSION MODELS
    ZHANG, P
    [J]. BIOMETRIKA, 1992, 79 (04) : 741 - 746
  • [22] New Robust Variable Selection Methods for Linear Regression Models
    Chen, Ziqi
    Tang, Man-Lai
    Gao, Wei
    Shi, Ning-Zhong
    [J]. SCANDINAVIAN JOURNAL OF STATISTICS, 2014, 41 (03) : 725 - 741
  • [23] Variable selection in partially linear additive models for modal regression
    Lv, Jing
    Yang, Hu
    Guo, Chaohui
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (07) : 5646 - 5665
  • [24] On variable selection in linear regression
    Kabaila, P
    [J]. ECONOMETRIC THEORY, 2002, 18 (04) : 913 - 925
  • [25] Variable selection in linear regression
    Lindsey, Charles
    Sheather, Simon
    [J]. STATA JOURNAL, 2010, 10 (04): : 650 - 669
  • [26] Finite mixture-based Bayesian analysis of linear-circular models
    Ashis SenGupta
    Sourabh Bhattacharya
    [J]. Environmental and Ecological Statistics, 2015, 22 : 667 - 679
  • [27] Finite mixture-based Bayesian analysis of linear-circular models
    SenGupta, Ashis
    Bhattacharya, Sourabh
    [J]. ENVIRONMENTAL AND ECOLOGICAL STATISTICS, 2015, 22 (04) : 667 - 679
  • [28] Genetic algorithms for outlier detection and variable selection in linear regression models
    Tolvi, J
    [J]. SOFT COMPUTING, 2004, 8 (08) : 527 - 533
  • [29] SOME VARIABLE SELECTION PROCEDURES IN MULTIVARIATE LINEAR-REGRESSION MODELS
    HUANG, DY
    LIU, KC
    [J]. JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1994, 41 (02) : 205 - 214
  • [30] BUILDING VARIABLE SELECTION ENSEMBLES FOR LINEAR REGRESSION MODELS BY ADDING NOISE
    Wang, Guan-Wei
    Zhang, Chun-Xia
    [J]. PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOL. 2, 2015, : 554 - 559