The Power of Convex Relaxation: Near-Optimal Matrix Completion

被引:1294
|
作者
Candes, Emmanuel J. [1 ]
Tao, Terence [2 ]
机构
[1] CALTECH, Dept Appl & Computat Math, Pasadena, CA 91125 USA
[2] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
关键词
Duality in optimization; free probability; low-rank matrices; matrix completion; nuclear norm minimization; random matrices and techniques from random matrix theory; semidefinite programming; INEQUALITIES; INFORMATION;
D O I
10.1109/TIT.2010.2044061
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper is concerned with the problem of recovering an unknown matrix from a small fraction of its entries. This is known as the matrix completion problem, and comes up in a great number of applications, including the famous Netflix Prize and other similar questions in collaborative filtering. In general, accurate recovery of a matrix from a small number of entries is impossible, but the knowledge that the unknown matrix has low rank radically changes this premise, making the search for solutions meaningful. This paper presents optimality results quantifying the minimum number of entries needed to recover a matrix of rank r exactly by any method whatsoever (the information theoretic limit). More importantly, the paper shows that, under certain incoherence assumptions on the singular vectors of the matrix, recovery is possible by solving a convenient convex program as soon as the number of entries is on the order of the information theoretic limit (up to logarithmic factors). This convex program simply finds, among all matrices consistent with the observed entries, that with minimum nuclear norm. As an example, we show that on the order of nr log(n) samples are needed to recover a random n x n matrix of rank by any method, and to be sure, nuclear norm minimization succeeds as soon as the number of entries is of the form nr log(n).
引用
收藏
页码:2053 / 2080
页数:28
相关论文
共 50 条
  • [31] Near-optimal Evasion of Randomized Convex-inducing Classifiers in Adversarial Environments
    Madani, Pooria
    Vlajic, Natalija
    [J]. 14TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY (ARES 2019), 2019,
  • [32] Matrix Completion via Non-Convex Relaxation and Adaptive Correlation Learning
    Li, Xuelong
    Zhang, Hongyuan
    Zhang, Rui
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1981 - 1991
  • [33] Near-Optimal Decentralized Power Supply Restoration in Smart Grids
    Agrawal, Pritee
    Kumar, Akshat
    Varakantham, Pradeep
    [J]. PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), 2015, : 1275 - 1283
  • [34] Near-Optimal Control of Net Output Power for PEMFC System
    Zhu, Yun
    Li, Shuai
    Xie, Yucen
    Zou, Jianxiao
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 2801 - 2806
  • [35] Adaptive Near-Optimal Compensation in Lossy Polyphase Power Systems
    Lev-Ari, Hanoch
    Hernandez, Ronald D.
    Stankovic, Aleksandar M.
    Marengo, Edwin A.
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2018, 26 (02) : 732 - 739
  • [36] The near-optimal feasible space of a renewable power system model
    Neumann, Fabian
    Brown, Tom
    [J]. ELECTRIC POWER SYSTEMS RESEARCH, 2021, 190
  • [37] Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Time
    Chepurko, Nadiia
    Clarkson, Kenneth L.
    Kacham, Praneeth
    Woodruff, David P.
    [J]. PROCEEDINGS OF THE 2022 ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, SODA, 2022, : 3043 - 3068
  • [38] Near-Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Time
    Chepurko, Nadiia
    Clarkson, Kenneth L.
    Kacham, Praneeth
    Woodru, David P.
    [J]. Proceedings of the Annual ACM-SIAM Symposium on Discrete Algorithms, 2022, 2022-January : 3043 - 3068
  • [39] Computing Near-Optimal Stable Cost Allocations for Cooperative Games by Lagrangian Relaxation
    Liu, Lindong
    Qi, Xiangtong
    Xu, Zhou
    [J]. INFORMS JOURNAL ON COMPUTING, 2016, 28 (04) : 687 - 702
  • [40] Universal Near-Optimal Feedbacks
    S. Nobakhtian
    R. J. Stern
    [J]. Journal of Optimization Theory and Applications, 2000, 107 : 89 - 122