Scalable Incremental Nonconvex Optimization Approach for Phase Retrieval

被引:0
|
作者
Li, Ji [1 ]
Cai, Lian-Feng [2 ]
Zhao, Hongkai [3 ]
机构
[1] Beijing Computat Sci Res Ctr, Beijing, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Math, Kowloon, Clear Water Bay, Hong Kong, Peoples R China
[3] Univ Calif Irvine, Dept Math, Irvine, CA 92717 USA
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Phase retrieval; Convex relaxation; Nonconvex optimization; Semidefinite programming; 49N30; 49N45; 94A20;
D O I
10.1007/s10915-021-01425-y
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We aim to find a solution x is an element of Cn to a system of quadratic equations of the form bi=|aix|2, i=1,2,...,m, e.g., the well-known NP-hard phase retrieval problem. As opposed to recently proposed state-of-the-art nonconvex methods, we revert to the semidefinite relaxation (SDR) PhaseLift convex formulation and propose a successive and incremental nonconvex optimization algorithm, termed as IncrePR, to indirectly minimize the resulting convex problem on the cone of positive semidefinite matrices. Our proposed method overcomes the excessive computational cost of typical SDP solvers as well as the need of a good initialization for typical nonconvex methods. For Gaussian measurements, which is usually needed for provable convergence of nonconvex methods, restart-IncrePR solving three consecutive PhaseLift problems outperforms state-of-the-art nonconvex gradient flow based solvers with a sharper phase transition of perfect recovery and typical convex solvers in terms of computational cost and storage. For more challenging structured (non-Gaussian) measurements often occurred in real applications, such as transmission matrix and oversampling Fourier transform, IncrePR with several consecutive repeats can be used to find a good initial guess. With further refinement by local nonconvex solvers, one can achieve a better solution than that obtained by applying nonconvex gradient flow based solvers directly when the number of measurements is relatively small. Extensive numerical tests are performed to demonstrate the effectiveness of the proposed method.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Scalable Incremental Nonconvex Optimization Approach for Phase Retrieval
    Ji Li
    Jian-Feng Cai
    Hongkai Zhao
    Journal of Scientific Computing, 2021, 87
  • [2] A Nonconvex Approach for Phase Retrieval: Reshaped Wirtinger Flow and Incremental Algorithms
    Zhang, Huishuai
    Zhou, Yi
    Liang, Yingbin
    Chi, Yuejie
    JOURNAL OF MACHINE LEARNING RESEARCH, 2017, 18
  • [3] A NONCONVEX REGULARIZED APPROACH FOR PHASE RETRIEVAL
    Repetti, Audrey
    Chouzenoux, Emilie
    Pesquet, Jean-Christophe
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1753 - 1757
  • [4] Misspecified nonconvex statistical optimization for sparse phase retrieval
    Zhuoran Yang
    Lin F. Yang
    Ethan X. Fang
    Tuo Zhao
    Zhaoran Wang
    Matey Neykov
    Mathematical Programming, 2019, 176 : 545 - 571
  • [5] Misspecified nonconvex statistical optimization for sparse phase retrieval
    Yang, Zhuoran
    Yang, Lin F.
    Fang, Ethan X.
    Zhao, Tuo
    Wang, Zhaoran
    Neykov, Matey
    MATHEMATICAL PROGRAMMING, 2019, 176 (1-2) : 545 - 571
  • [6] A Distributed, Asynchronous, and Incremental Algorithm for Nonconvex Optimization: An ADMM Approach
    Hong, Mingyi
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2018, 5 (03): : 935 - 945
  • [7] Median-Truncated Nonconvex Approach for Phase Retrieval With Outliers
    Zhang, Huishuai
    Chi, Yuejie
    Liang, Yingbin
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (11) : 7287 - 7310
  • [8] Incremental Without Replacement Sampling in Nonconvex Optimization
    Edouard Pauwels
    Journal of Optimization Theory and Applications, 2021, 190 : 274 - 299
  • [9] Fast Incremental Method for Smooth Nonconvex Optimization
    Reddi, Sashank J.
    Sra, Suvrit
    Poczos, Barnabas
    Smola, Alex
    2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 1971 - 1977
  • [10] Incremental Without Replacement Sampling in Nonconvex Optimization
    Pauwels, Edouard
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 190 (01) : 274 - 299