Compressive phase retrieval: Optimal sample complexity with deep generative priors

被引:0
|
作者
Hand, Paul [1 ,2 ]
Leong, Oscar [3 ]
Voroninski, Vladislav [4 ]
机构
[1] Northeastern Univ, Dept Math, Boston, MA USA
[2] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA USA
[3] CALTECH, Dept Comp & Math Sci, Pasadena, CA 91125 USA
[4] Helm Ai, Menlo Pk, CA USA
基金
美国国家科学基金会;
关键词
RESTRICTED ISOMETRY PROPERTY; STABLE SIGNAL RECOVERY; QUADRATIC MEASUREMENTS; IMAGE; ALGORITHMS;
D O I
10.1002/cpa.22155
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Advances in compressive sensing (CS) provided reconstruction algorithms of sparse signals from linear measurements with optimal sample complexity, but natural extensions of this methodology to nonlinear inverse problems have been met with potentially fundamental sample complexity bottlenecks. In particular, tractable algorithms for compressive phase retrieval with sparsity priors have not been able to achieve optimal sample complexity. This has created an open problem in compressive phase retrieval: under generic, phaseless linear measurements, are there tractable reconstruction algorithms that succeed with optimal sample complexity? Meanwhile, progress in machine learning has led to the development of new data-driven signal priors in the form of generative models, which can outperform sparsity priors with significantly fewer measurements. In this work, we resolve the open problem in compressive phase retrieval and demonstrate that generative priors can lead to a fundamental advance by permitting optimal sample complexity by a tractable algorithm. We additionally provide empirics showing that exploiting generative priors in phase retrieval can significantly outperform sparsity priors. These results provide support for generative priors as a new paradigm for signal recovery in a variety of contexts, both empirically and theoretically. The strengths of this paradigm are that (1) generative priors can represent some classes of natural signals more concisely than sparsity priors, (2) generative priors allow for direct optimization over the natural signal manifold, which is intractable under sparsity priors, and (3) the resulting non-convex optimization problems with generative priors can admit benign optimization landscapes at optimal sample complexity, perhaps surprisingly, even in cases of nonlinear measurements.
引用
收藏
页码:1147 / 1223
页数:77
相关论文
共 50 条
  • [1] Towards Sample-Optimal Compressive Phase Retrieval with Sparse and Generative Priors
    Liu, Zhaoqiang
    Ghosh, Subhroshekhar
    Scarlett, Jonathan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [2] COMPRESSIVE PHASE RETRIEVAL BASED ON SPARSE LATENT GENERATIVE PRIORS
    Killedar, Vinayak
    Seelamantula, Chandra Sekhar
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1596 - 1600
  • [3] ALTERNATING PHASE PROJECTED GRADIENT DESCENT WITH GENERATIVE PRIORS FOR SOLVING COMPRESSIVE PHASE RETRIEVAL
    Hyder, Rakib
    Shah, Viraj
    Hegde, Chinmay
    Asif, M. Salman
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 7705 - 7709
  • [4] Misspecified Phase Retrieval with Generative Priors
    Liu, Zhaoqiang
    Wang, Xinshao
    Liu, Jiulong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] Compressed Sensing-Based Robust Phase Retrieval via Deep Generative Priors
    Shamshad, Fahad
    Ahmed, Ali
    IEEE SENSORS JOURNAL, 2021, 21 (02) : 2286 - 2298
  • [6] Optimally Sample-Efficient Phase Retrieval with Deep Generative Models
    Hand, Paul
    Leong, Oscar
    Voroninski, Vladislav
    2019 13TH INTERNATIONAL CONFERENCE ON SAMPLING THEORY AND APPLICATIONS (SAMPTA), 2019,
  • [7] Low-Light Phase Retrieval With Implicit Generative Priors
    Manekar, Raunak
    Negrini, Elisa
    Pham, Minh
    Jacobs, Daniel
    Srivastava, Jaideep
    Osher, Stanley J.
    Miao, Jianwei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4728 - 4737
  • [8] Exact asymptotics for phase retrieval and compressed sensing with random generative priors
    Aubin, Benjamin
    Loureiro, Bruno
    Baker, Antoine
    Krzakala, Florent
    Zdeborova, Lenka
    MATHEMATICAL AND SCIENTIFIC MACHINE LEARNING, VOL 107, 2020, 107 : 55 - 73
  • [9] HIONet: Deep priors based deep unfolded network for phase retrieval
    Yang, Yuchi
    Lian, Qiusheng
    Zhang, Xiaohua
    Zhang, Dan
    Zhang, Huibin
    DIGITAL SIGNAL PROCESSING, 2022, 132
  • [10] On Efficiency and Low Sample Complexity in Phase Retrieval
    Mroueh, Youssef
    Rosasco, Lorenzo
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 931 - 935