Compressive phase retrieval: Optimal sample complexity with deep generative priors

被引:0
|
作者
Hand, Paul [1 ,2 ]
Leong, Oscar [3 ]
Voroninski, Vladislav [4 ]
机构
[1] Northeastern Univ, Dept Math, Boston, MA USA
[2] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA USA
[3] CALTECH, Dept Comp & Math Sci, Pasadena, CA 91125 USA
[4] Helm Ai, Menlo Pk, CA USA
基金
美国国家科学基金会;
关键词
RESTRICTED ISOMETRY PROPERTY; STABLE SIGNAL RECOVERY; QUADRATIC MEASUREMENTS; IMAGE; ALGORITHMS;
D O I
10.1002/cpa.22155
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Advances in compressive sensing (CS) provided reconstruction algorithms of sparse signals from linear measurements with optimal sample complexity, but natural extensions of this methodology to nonlinear inverse problems have been met with potentially fundamental sample complexity bottlenecks. In particular, tractable algorithms for compressive phase retrieval with sparsity priors have not been able to achieve optimal sample complexity. This has created an open problem in compressive phase retrieval: under generic, phaseless linear measurements, are there tractable reconstruction algorithms that succeed with optimal sample complexity? Meanwhile, progress in machine learning has led to the development of new data-driven signal priors in the form of generative models, which can outperform sparsity priors with significantly fewer measurements. In this work, we resolve the open problem in compressive phase retrieval and demonstrate that generative priors can lead to a fundamental advance by permitting optimal sample complexity by a tractable algorithm. We additionally provide empirics showing that exploiting generative priors in phase retrieval can significantly outperform sparsity priors. These results provide support for generative priors as a new paradigm for signal recovery in a variety of contexts, both empirically and theoretically. The strengths of this paradigm are that (1) generative priors can represent some classes of natural signals more concisely than sparsity priors, (2) generative priors allow for direct optimization over the natural signal manifold, which is intractable under sparsity priors, and (3) the resulting non-convex optimization problems with generative priors can admit benign optimization landscapes at optimal sample complexity, perhaps surprisingly, even in cases of nonlinear measurements.
引用
收藏
页码:1147 / 1223
页数:77
相关论文
共 50 条
  • [21] Joint ptycho-tomography with deep generative priors
    Aslan, Selin
    Liu, Zhengchun
    Nikitin, Viktor
    Bicer, Tekin
    Leyffer, Sven
    Gursoy, Doga
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2021, 2 (04):
  • [22] Blind Image Deconvolution Using Deep Generative Priors
    Asim, Muhammad
    Shamshad, Fahad
    Ahmed, Ali
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 1493 - 1506
  • [23] Stable Deep MRI Reconstruction Using Generative Priors
    Zach, Martin
    Knoll, Florian
    Pock, Thomas
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (12) : 3817 - 3832
  • [24] Fast Compressive Phase Retrieval
    Viswanathan, Aditya
    Iwen, Mark
    2015 49TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, 2015, : 1686 - 1690
  • [25] Optimal complexity of deployable compressive structures
    Skelton, Robert E.
    de Oliveira, Mauricio C.
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2010, 347 (01): : 228 - 256
  • [26] DEEP PTYCH: SUBSAMPLED FOURIER PTYCHOGRAPHY USING GENERATIVE PRIORS
    Shamshad, Fahad
    Abbas, Farwa
    Ahmed, Ali
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7720 - 7724
  • [27] Global Guarantees for Enforcing Deep Generative Priors by Empirical Risk
    Hand, Paul
    Voroninski, Vladislav
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (01) : 401 - 418
  • [28] Learning without the Phase: Regularized PhaseMax Achieves Optimal Sample Complexity
    Salehi, Fariborz
    Abbasi, Ehsan
    Hassibi, Babak
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [29] Phase Transitions and Sample Complexity in Bayes-Optimal Matrix Factorization
    Kabashima, Yoshiyuki
    Krzakala, Florent
    Mezard, Marc
    Sakata, Ayaka
    Zdeborova, Lenka
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (07) : 4228 - 4265
  • [30] Phase Retrieval Under a Generative Prior
    Hand, Paul
    Leong, Oscar
    Voroninski, Vladislav
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31