Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent

被引:1
|
作者
Wu, Fan [1 ]
Rebeschini, Patrick [1 ]
机构
[1] Univ Oxford, Dept Stat, 24-29 St Giles, Oxford OX1 3LB, England
基金
英国工程与自然科学研究理事会;
关键词
mirror descent; early stopping; sparsity; minimax rate; implicit regularization; non-convex empirical risk; phase retrieval; GRADIENT DESCENT; CONVERGENCE; ALGORITHMS;
D O I
10.1093/imaiai/iaac024
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper studies early-stopped mirror descent applied to noisy sparse phase retrieval, which is the problem of recovering a k-sparse signal x* epsilon R-n from a set of quadratic Gaussian measurements corrupted by sub-exponential noise. We consider the (non-convex) unregularized empirical risk minimization problem and show that early-stopped mirror descent, when equipped with the hypentropy mirror map and proper initialization, achieves a nearly minimax-optimal rate of convergence, provided the sample size is at least of order k2 (modulo logarithmic term) and the minimum (in modulus) non-zero entry of the signal is on the order of ||x*||2/root k. Our theory leads to a simple algorithm that does not rely on explicit regularization or thresholding steps to promote sparsity. More generally, our results establish a connection between mirror descent and sparsity in the non-convex problem of noisy sparse phase retrieval, adding to the literature on early stopping that has mostly focused on non-sparse, Euclidean and convex settings via gradient descent. Our proof combines a potential-based analysis of mirror descent with a quantitative control on a variational coherence property that we establish along the path of mirror descent, up to a prescribed stopping time.
引用
收藏
页码:633 / 713
页数:81
相关论文
共 2 条
  • [1] OPTIMAL RATES OF CONVERGENCE FOR NOISY SPARSE PHASE RETRIEVAL VIA THRESHOLDED WIRTINGER FLOW
    Cai, T. Tony
    Li, Xiaodong
    Ma, Zongming
    [J]. ANNALS OF STATISTICS, 2016, 44 (05): : 2221 - 2251
  • [2] Minimax-Optimal Rates For Sparse Additive Models Over Kernel Classes Via Convex Programming
    Raskutti, Garvesh
    Wainwright, Martin J.
    Yu, Bin
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2012, 13 : 389 - 427