Low-rank tensor regression for selection of grouped variables

被引:0
|
作者
Chen, Yang [1 ]
Luo, Ziyan [1 ]
Kong, Lingchen [1 ]
机构
[1] Beijing Jiaotong Univ, Sch Math & Stat, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
Alternating minimization; Group selection; Low-rankness; Orthogonal decomposition; Tensor regression; DECOMPOSITIONS; SLOPE;
D O I
10.1016/j.jmva.2024.105339
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Low-rank tensor regression (LRTR) problems are widely studied in statistics and machine learning, in which the regressors are generally grouped by clustering strongly correlated variables or variables corresponding to different levels of the same predictive factor in many practical applications. By virtue of the idea of group selection in the classical linear regression framework, we propose an LRTR method for adaptive selection of grouped variables in this article, which is formulated as a group SLOPE penalized low-rank, orthogonally decomposable tensor optimization problem. Moreover, we introduce the notion of tensor group false discovery rate (TgFDR) to measure the group selection performance. The proposed regression method provably controls TgFDR and achieves the asymptotically minimax estimate under the assumption that variable groups are orthogonal to each other. Finally, an alternating minimization algorithm is developed for efficient problem resolution. We demonstrate the performance of our proposed method in group selection and low-rank estimation through simulation studies and real dataset analysis.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Low-Rank Regression with Tensor Responses
    Rabusseau, Guillaume
    Kadri, Hachem
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [2] LOW-RANK TENSOR HUBER REGRESSION
    Wei, Yangxin
    Luot, Ziyan
    Chen, Yang
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2022, 18 (02): : 439 - 458
  • [3] Low-rank Tensor Regression: Scalability and Applications
    Liu, Yan
    [J]. 2017 IEEE 7TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2017,
  • [4] Low-Rank Tensor Thresholding Ridge Regression
    Guo, Kailing
    Zhang, Tong
    Xu, Xiangmin
    Xing, Xiaofen
    [J]. IEEE ACCESS, 2019, 7 : 153761 - 153772
  • [5] Boosted Sparse and Low-Rank Tensor Regression
    He, Lifang
    Chen, Kun
    Xu, Wanwan
    Zhou, Jiayu
    Wang, Fei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [6] TENSOR QUANTILE REGRESSION WITH LOW-RANK TENSOR TRAIN ESTIMATION
    Liu, Zihuan
    Lee, Cheuk Yin
    Zhang, Heping
    [J]. ANNALS OF APPLIED STATISTICS, 2024, 18 (02): : 1294 - 1318
  • [7] Fast Recursive Low-rank Tensor Learning for Regression
    Hou, Ming
    Chaib-draa, Brahim
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1851 - 1857
  • [8] Near Optimal Sketching of Low-Rank Tensor Regression
    Haupt, Jarvis
    Li, Xingguo
    Woodruff, David P.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [9] Group SLOPE Penalized Low-Rank Tensor Regression
    Chen, Yang
    Luo, Ziyan
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [10] Robust Low-Rank and Sparse Tensor Decomposition for Low-Rank Tensor Completion
    Shi, Yuqing
    Du, Shiqiang
    Wang, Weilan
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 7138 - 7143