Scalable Plug-and-Play ADMM With Convergence Guarantees

被引:52
|
作者
Sun, Yu [1 ]
Wu, Zihui [2 ]
Xu, Xiaojian [1 ]
Wohlberg, Brendt [3 ]
Kamilov, Ulugbek [1 ,4 ]
机构
[1] Washington Univ St Louis, Dept Comp Sci & Engn, St Louis, MO 63130 USA
[2] CALTECH, Dept Comp Sci, Pasadena, CA 91125 USA
[3] Los Alamos Natl Labora, Div Theoret, Los Alamos, NM 87545 USA
[4] Washington Univ, Dept Elect & Syst Engn, St Louis, MO 63130 USA
基金
美国国家科学基金会;
关键词
Convergence; Neural networks; Optimization; Scalability; Computer science; Approximation error; AWGN; Regularized image reconstruction; plug-and-play priors; deep learning; regularization parameter; INVERSE PROBLEMS; THRESHOLDING ALGORITHM; NEURAL-NETWORKS; IMAGE; RECONSTRUCTION; REGULARIZATION; RECOVERY; PRIORS; POINT;
D O I
10.1109/TCI.2021.3094062
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Plug-and-play priors (PnP) is a broadly applicable methodology for solving inverse problems by exploiting statistical priors specified as denoisers. Recent work has reported the state-of-the-art performance of PnP algorithms using pre-trained deep neural nets as denoisers in a number of imaging applications. However, current PnP algorithms are impractical in large-scale settings due to their heavy computational and memory requirements. This work addresses this issue by proposing an incremental variant of the widely used PnP-ADMM algorithm, making it scalable to problems involving a large number measurements. We theoretically analyze the convergence of the algorithm under a set of explicit assumptions, extending recent theoretical results in the area. Additionally, we show the effectiveness of our algorithm with nonsmooth data-fidelity terms and deep neural net priors, its fast convergence compared to existing PnP algorithms, and its scalability in terms of speed and memory.
引用
收藏
页码:849 / 863
页数:15
相关论文
共 50 条
  • [1] On the Proof of Fixed-Point Convergence for Plug-and-Play ADMM
    Gavaskar, Ruturaj Girish
    Chaudhury, Kunal Nara
    IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (12) : 1817 - 1821
  • [2] SCENE-ADAPTED PLUG-AND-PLAY ALGORITHM WITH CONVERGENCE GUARANTEES
    Teodoro, Afonso M.
    Bioucas-Dias, Jose M.
    Figueiredo, Mario A. T.
    2017 IEEE 27TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2017,
  • [3] Plug-and-Play ADMM for Image Restoration: Fixed-Point Convergence and Applications
    Chan, Stanley H.
    Wang, Xiran
    Elgendy, Omar A.
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2017, 3 (01) : 84 - 98
  • [4] SAR image despeckling using plug-and-play ADMM
    Baraha, Satyakam
    Sahoo, Ajit Kumar
    IET RADAR SONAR AND NAVIGATION, 2020, 14 (09): : 1297 - 1309
  • [5] A plug-and-play infrastructure for scalable bioinformatics operations
    Medina-Martinez, Juan S.
    Arango-Ossa, Juan E.
    Gundem, Gunes
    Levine, Max F.
    Patel, Minal
    Farnoud, Noushin R.
    Yellapantula, Venkata D.
    Teng, Gao
    Mccarter, Joseph G.
    Bernard, Elsa
    Rapaport, Franck
    Glodzik, Dominik
    Levine, Ross L.
    Kung, Andrew
    Papaemmanuil, Elli
    CANCER RESEARCH, 2019, 79 (13)
  • [6] INTERPOLATION AND DENOISING OF GRAPH SIGNALS USING PLUG-AND-PLAY ADMM
    Yazaki, Yoshinao
    Tanaka, Yuichi
    Chan, Stanley H.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 5431 - 5435
  • [7] PARAMETER-FREE PLUG-AND-PLAY ADMM FOR IMAGE RESTORATION
    Wang, Xiran
    Chan, Stanley H.
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1323 - 1327
  • [8] Noise Removal for Dynamic Mode Decomposition Based on Plug-and-Play ADMM
    Anami, Shunki
    Matsuoka, Ryo
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 1405 - 1409
  • [9] Preconditioned Plug-and-Play ADMM with Locally Adjustable Denoiser for Image Restoration
    Le Pendu, Mikael
    Guillemot, Christine
    SIAM JOURNAL ON IMAGING SCIENCES, 2023, 16 (01): : 393 - 422
  • [10] Scalable Network Approach for the Space Plug-and-play Architecture
    Christensen, Jacob H.
    Anderson, David B.
    Greenman, Mark E.
    Hansen, Bryan D.
    2012 IEEE AEROSPACE CONFERENCE, 2012,