Scalable Plug-and-Play ADMM With Convergence Guarantees

被引:52
|
作者
Sun, Yu [1 ]
Wu, Zihui [2 ]
Xu, Xiaojian [1 ]
Wohlberg, Brendt [3 ]
Kamilov, Ulugbek [1 ,4 ]
机构
[1] Washington Univ St Louis, Dept Comp Sci & Engn, St Louis, MO 63130 USA
[2] CALTECH, Dept Comp Sci, Pasadena, CA 91125 USA
[3] Los Alamos Natl Labora, Div Theoret, Los Alamos, NM 87545 USA
[4] Washington Univ, Dept Elect & Syst Engn, St Louis, MO 63130 USA
基金
美国国家科学基金会;
关键词
Convergence; Neural networks; Optimization; Scalability; Computer science; Approximation error; AWGN; Regularized image reconstruction; plug-and-play priors; deep learning; regularization parameter; INVERSE PROBLEMS; THRESHOLDING ALGORITHM; NEURAL-NETWORKS; IMAGE; RECONSTRUCTION; REGULARIZATION; RECOVERY; PRIORS; POINT;
D O I
10.1109/TCI.2021.3094062
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Plug-and-play priors (PnP) is a broadly applicable methodology for solving inverse problems by exploiting statistical priors specified as denoisers. Recent work has reported the state-of-the-art performance of PnP algorithms using pre-trained deep neural nets as denoisers in a number of imaging applications. However, current PnP algorithms are impractical in large-scale settings due to their heavy computational and memory requirements. This work addresses this issue by proposing an incremental variant of the widely used PnP-ADMM algorithm, making it scalable to problems involving a large number measurements. We theoretically analyze the convergence of the algorithm under a set of explicit assumptions, extending recent theoretical results in the area. Additionally, we show the effectiveness of our algorithm with nonsmooth data-fidelity terms and deep neural net priors, its fast convergence compared to existing PnP algorithms, and its scalability in terms of speed and memory.
引用
收藏
页码:849 / 863
页数:15
相关论文
共 50 条
  • [41] Plug-and-Play Digital Controllers for Scalable Low-Power SMPS
    Weinstein, Jason
    Prodic, Aleksandar
    2008 IEEE 11TH WORKSHOP ON CONTROL AND MODELING FOR POWER ELECTRONICS, 2008, : 294 - +
  • [42] Study on Convergence of Plug-and-Play ISTA With Adaptive-Kernel Denoisers
    Liu, Tingting
    Xing, Le
    Sun, Zhonggui
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1918 - 1922
  • [43] Plug-and-Play Conversational Models
    Madotto, Andrea
    Ishii, Etsuko
    Lin, Zhaojiang
    Dathathri, Sumanth
    Fung, Pascale
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 2422 - 2433
  • [44] Plug-and-Play Virtual Factories
    Schulte, Stefan
    Schuller, Dieter
    Steinmetz, Ralf
    Abels, Sven
    IEEE INTERNET COMPUTING, 2012, 16 (05) : 78 - 82
  • [45] Toward Software Plug-and-Play
    Software Eng Notes, 3 (19):
  • [46] Plug-and-Play for Medical Implants
    Madanipour, Sean
    MECHANICAL ENGINEERING, 2011, 133 (04) : 23 - 23
  • [47] PLUG-AND-PLAY HITS THE CPI
    FOUHY, K
    CHEMICAL ENGINEERING, 1995, 102 (09) : 5 - 5
  • [48] A plug-and-play production environment
    Lindholm, E
    DATAMATION, 1996, 42 (14): : 130 - &
  • [49] PLUG-AND-PLAY REGISTRATION AND FUSION
    Unni, V. S.
    Nair, Pravin
    Chaudhury, Kunal N.
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2546 - 2550
  • [50] BREGMAN PLUG-AND-PLAY PRIORS
    Al-Shabili, Abdullah H.
    Xu, Xiaojian
    Selesnick, Ivan
    Kamilov, Ulugbek S.
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 241 - 245