Learning sparse conditional distribution: An efficient kernel-based approach

被引:2
|
作者
Chen, Fang [1 ]
He, Xin [1 ]
Wang, Junhui [2 ]
机构
[1] Shanghai Univ Finance & Econ, Sch Stat & Management, Shanghai, Peoples R China
[2] City Univ Hong Kong, Sch Data Sci, Hong Kong, Peoples R China
来源
ELECTRONIC JOURNAL OF STATISTICS | 2021年 / 15卷 / 01期
关键词
Conditional distribution; consistency; parallel computing; RKHS; sparse learning; VARIABLE SELECTION; QUANTILE REGRESSION; CONSISTENCY; LIKELIHOOD; RETURNS;
D O I
10.1214/21-EJS1824
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
This paper proposes a novel method to recover the sparse structure of the conditional distribution, which plays a crucial role in subsequent statistical analysis such as prediction, forecasting, conditional distribution estimation and others. Unlike most existing methods that often require explicit model assumption or suffer from computational burden, the proposed method shows great advantage by making use of some desirable properties of reproducing kernel Hilbert space (RKHS). It can be efficiently implemented by optimizing its dual form and is particularly attractive in dealing with large-scale dataset. The asymptotic consistencies of the proposed method are established under mild conditions. Its effectiveness is also supported by a variety of simulated examples and a real-life supermarket dataset from Northern China.
引用
收藏
页码:1610 / 1635
页数:26
相关论文
共 50 条
  • [41] Bounded Kernel-Based Online Learning
    Orabona, Francesco
    Keshet, Joseph
    Caputo, Barbara
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 2643 - 2666
  • [42] Practical Kernel-Based Reinforcement Learning
    Barreto, Andre M. S.
    Precup, Doina
    Pineau, Joelle
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [43] A kernel-based approach to learning contact distributions for robot manipulation tasks
    Oliver Kroemer
    Simon Leischnig
    Stefan Luettgen
    Jan Peters
    [J]. Autonomous Robots, 2018, 42 : 581 - 600
  • [44] Recommendation as Link Prediction: A Graph Kernel-based Machine Learning Approach
    Li, Xin
    Chen, Hsinchun
    [J]. JCDL 09: PROCEEDINGS OF THE 2009 ACM/IEEE JOINT CONFERENCE ON DIGITAL LIBRARIES, 2009, : 213 - 216
  • [45] A kernel-based approach to learning contact distributions for robot manipulation tasks
    Kroemer, Oliver
    Leischnig, Simon
    Luettgen, Stefan
    Peters, Jan
    [J]. AUTONOMOUS ROBOTS, 2018, 42 (03) : 581 - 600
  • [46] Support Kernel Classification: A New Kernel-Based Approach
    Bchir, Ouiem
    Ben Ismail, Mohamed M.
    Algarni, Sara
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (10) : 17 - 26
  • [47] A Kernel-Based Learning Approach to Ad Hoc Sensor Network Localization
    Nguyen, Xuanlong
    Jordan, Michael I.
    Sinopoli, Bruno
    [J]. ACM TRANSACTIONS ON SENSOR NETWORKS, 2005, 1 (01)
  • [48] Kernel-based Approach for Learning Causal Graphs from Mixed Data
    Handhayani, Teny
    Cussens, James
    [J]. INTERNATIONAL CONFERENCE ON PROBABILISTIC GRAPHICAL MODELS, VOL 138, 2020, 138 : 221 - 232
  • [49] EFFICIENT KERNEL-BASED VARIABLE SELECTION WITH SPARSISTENCY
    He, Xin
    Wang, Junhui
    Lv, Shaogao
    [J]. STATISTICA SINICA, 2021, 31 (04) : 2123 - 2151
  • [50] A CROSS-VALIDATION APPROACH TO BANDWIDTH SELECTION FOR A KERNEL-BASED ESTIMATE OF THE DENSITY OF A CONDITIONAL EXPECTATION
    Avramidis, Athanassios N.
    [J]. PROCEEDINGS OF THE 2011 WINTER SIMULATION CONFERENCE (WSC), 2011, : 439 - 443