THE FUSED KOLMOGOROV FILTER: A NONPARAMETRIC MODEL-FREE SCREENING METHOD

被引:95
|
作者
Mai, Qing [1 ]
Zou, Hui [2 ]
机构
[1] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
[2] Univ Minnesota, Sch Stat, Minneapolis, MN 55455 USA
来源
ANNALS OF STATISTICS | 2015年 / 43卷 / 04期
基金
美国国家科学基金会;
关键词
Variable screening; high-dimensional data; sure screening property; SLICED INVERSE REGRESSION; VARIABLE SELECTION; CLASSIFICATION; ESTIMATORS; LIKELIHOOD;
D O I
10.1214/14-AOS1303
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
A new model-free screening method called the fused Kolmogorov filter is proposed for high-dimensional data analysis. This new method is fully nonparametric and can work with many types of covariates and response variables, including continuous, discrete and categorical variables. We apply the fused Kolmogorov filter to deal with variable screening problems emerging from a wide range of applications, such as multiclass classification, nonparametric regression and Poisson regression, among others. It is shown that the fused Kolmogorov filter enjoys the sure screening property under weak regularity conditions that are much milder than those required for many existing nonparametric screening methods. In particular, the fused Kolmogorov filter can still be powerful when covariates are strongly dependent on each other. We further demonstrate the superior performance of the fused Kolmogorov filter over existing screening methods by simulations and real data examples.
引用
收藏
页码:1471 / 1497
页数:27
相关论文
共 50 条
  • [1] The cumulative Kolmogorov filter for model-free screening in ultrahigh dimensional data
    Kim, Arlene Kyoung Hee
    Shin, Seung Jun
    [J]. STATISTICS & PROBABILITY LETTERS, 2017, 126 : 238 - 243
  • [2] The concordance filter: an adaptive model-free feature screening procedure
    Cheng, Xuewei
    Li, Gang
    Wang, Hong
    [J]. COMPUTATIONAL STATISTICS, 2024, 39 (05) : 2413 - 2436
  • [3] A Model-free Variable Screening Method Based on Leverage Score
    Zhong, Wenxuan
    Liu, Yiwen
    Zeng, Peng
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (541) : 135 - 146
  • [4] Unified model-free interaction screening via CV-entropy filter
    Xiong, Wei
    Chen, Yaxian
    Ma, Shuangge
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2023, 180
  • [5] Model-free prediction of time series: a nonparametric approach
    Mohammadi, Mohammad
    Li, Meng
    [J]. JOURNAL OF NONPARAMETRIC STATISTICS, 2024, 36 (03) : 804 - 824
  • [6] A SCREENING METHOD FOR A NONPARAMETRIC MODEL
    KOWALCZYK, T
    MIELNICZUK, J
    [J]. STATISTICS & PROBABILITY LETTERS, 1987, 5 (03) : 163 - 167
  • [7] Model-free data screening and cleaning
    Tarter, Michael E.
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2011, 3 (02): : 168 - 176
  • [8] Adaptive model-free sure independence screening
    Wen, Canhong
    Zhu, Shan
    Chen, Xin
    Wang, Xueqin
    [J]. STATISTICS AND ITS INTERFACE, 2017, 10 (03) : 399 - 406
  • [9] Model-free screening for variables with treatment interaction
    Bizuayehu, Shiferaw B.
    Xu, Jin
    [J]. STATISTICAL METHODS IN MEDICAL RESEARCH, 2022, 31 (10) : 1845 - 1859
  • [10] Model-free survival conditional feature screening
    Chen, Xiaolin
    Liu, Wei
    Chen, Xiaojing
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2022, 51 (10) : 5690 - 5708