Approximately low-rank recovery from noisy and local measurements by convex program

被引:1
|
作者
Lee, Kiryung [1 ]
Sharma, Rakshith Srinivasa [2 ]
Junge, Marius [3 ]
Romberg, Justin [1 ]
机构
[1] Ohio State Univ, Dept Elect & Comp Engn, Columbus, OH 43210 USA
[2] Georgia Inst Technol, Sch Elect & Comp Engn, Atlanta, GA 30308 USA
[3] Univ Illinois, Dept Math, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
regularized estimation; lasso; low-rank matrices; tensor product; MATRIX COMPLETION; NORM; DECOMPOSITION; INEQUALITIES; SUBSPACES; DIMENSION; SPACES;
D O I
10.1093/imaiai/iaad013
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Low-rank matrix models have been universally useful for numerous applications, from classical system identification to more modern matrix completion in signal processing and statistics. The nuclear norm has been employed as a convex surrogate of the low-rankness since it induces a low-rank solution to inverse problems. While the nuclear norm for low rankness has an excellent analogy with the L-1 norm for sparsity through the singular value decomposition, other matrix norms also induce low-rankness. Particularly as one interprets a matrix as a linear operator between Banach spaces, various tensor product norms generalize the role of the nuclear norm. We provide a tensor-norm-constrained estimator for the recovery of approximately low-rank matrices from local measurements corrupted with noise. A tensor norm regularizer is designed to adapt to the local structure. We derive statistical analysis of the estimator over matrix completion and decentralized sketching by applying Maurey's empirical method to tensor products of Banach spaces. The estimator provides a near-optimal error bound in a minimax sense and admits a polynomial-time algorithm for these applications.
引用
收藏
页数:43
相关论文
共 50 条
  • [41] Hyperspectral Image Recovery Using Non-Convex Low-Rank Tensor Approximation
    Liu, Hongyi
    Li, Hanyang
    Wu, Zebin
    Wei, Zhihui
    REMOTE SENSING, 2020, 12 (14)
  • [42] Low-Rank Approximation of Circulant Matrix to a Noisy Matrix
    Al-Homidan, Suliman
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2021, 46 (04) : 3287 - 3292
  • [43] Low-Rank Approximation of Circulant Matrix to a Noisy Matrix
    Suliman Al-Homidan
    Arabian Journal for Science and Engineering, 2021, 46 : 3287 - 3292
  • [44] FAST AND STABLE RECOVERY OF APPROXIMATELY LOW MULTILINEAR RANK TENSORS FROM MULTI-WAY COMPRESSIVE MEASUREMENTS
    Caiafa, Cesar F.
    Cichocki, Andrzej
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [45] Low rank matrix recovery from rank one measurements
    Kueng, Richard
    Rauhut, Holger
    Terstiege, Ulrich
    APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2017, 42 (01) : 88 - 116
  • [46] An Overview of Low-Rank Matrix Recovery From Incomplete Observations
    Davenport, Mark A.
    Romberg, Justin
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2016, 10 (04) : 608 - 622
  • [47] RECOVERING LOW-RANK AND SPARSE COMPONENTS OF MATRICES FROM INCOMPLETE AND NOISY OBSERVATIONS
    Tao, Min
    Yuan, Xiaoming
    SIAM JOURNAL ON OPTIMIZATION, 2011, 21 (01) : 57 - 81
  • [48] On the Absence of Spurious Local Minima in Nonlinear Low-Rank Matrix Recovery Problems
    Bi, Yingjie
    Lavaei, Javad
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130 : 379 - +
  • [49] Local and Global Linear Convergence of General Low-Rank Matrix Recovery Problems
    Bi, Yingjie
    Zhang, Haixiang
    Lavaei, Javad
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 10129 - 10137
  • [50] LOW-RANK MATRIX ESTIMATION FROM RANK-ONE PROJECTIONS BY UNLIFTED CONVEX OPTIMIZATION
    Bahmani, Sohail
    Lee, Kiryung
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2021, 42 (03) : 1119 - 1147