REGULARIZATION VIA DEEP GENERATIVE MODELS: AN ANALYSIS POINT OF VIEW

被引:4
|
作者
Oberlin, Thomas [1 ]
Verm, Mathieu [1 ]
机构
[1] Univ Toulouse, ISAE SUPAERO, 10 Ave Edouard Belin, F-31400 Toulouse, France
关键词
inverse problems; regularization; generative models; deep regularization; data-driven priors;
D O I
10.1109/ICIP42928.2021.9506138
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since the same network can be used for many different problems and experimental conditions, as soon as the generative model is suited to the data. Previous works proposed to use a synthesis framework, where the estimation is performed on the latent vector, the solution being obtained afterwards via the decoder. Instead, we propose an analysis formulation where we directly optimize the image itself and penalize the latent vector. We illustrate the interest of such a formulation by running experiments of inpainting, deblurring and super-resolution. In many cases our technique achieves a clear improvement of the performance and seems to be more robust, in particular with respect to initialization.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [1] On Explicit Curvature Regularization in Deep Generative Models
    Lee, Yonghyeon
    Park, Frank C.
    TOPOLOGICAL, ALGEBRAIC AND GEOMETRIC LEARNING WORKSHOPS 2023, VOL 221, 2023, 221
  • [2] Clustering Analysis via Deep Generative Models With Mixture Models
    Yang, Lin
    Fan, Wentao
    Bouguila, Nizar
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (01) : 340 - 350
  • [3] Field-of-view extension for brain diffusion MRI via deep generative models
    Gao, Chenyu
    Bao, Shunxing
    Kim, Michael E.
    Newlin, Nancy R.
    Kanakaraj, Praitayini
    Yao, Tianyuan
    Rudravaram, Gaurav
    Huo, Yuankai
    Moyer, Daniel
    Schilling, Kurt
    Kukull, Walter A.
    Toga, Arthur W.
    Archer, Derek B.
    Hohman, Timothy J.
    Landman, Bennett A.
    Li, Zhiyuan
    JOURNAL OF MEDICAL IMAGING, 2024, 11 (04)
  • [4] Interpreting Deep Models for Text Analysis via Optimization and Regularization Methods
    Yuan, Hao
    Chen, Yongjun
    Hu, Xia
    Ji, Shuiwang
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5717 - 5724
  • [5] Wasserstein Learning of Deep Generative Point Process Models
    Xiao, Shuai
    Farajtabar, Mehrdad
    Ye, Xiaojing
    Yang, Junchi
    Song, Le
    Zha, Hongyuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [6] Discriminative and generative models for anatomical shape analysis on point clouds with deep neural networks
    Gutierrez-Becker, Benjamin
    Sarasua, Ignacio
    Wachinger, Christian
    MEDICAL IMAGE ANALYSIS, 2021, 67
  • [7] Training Deep Generative Models in Highly Incomplete Data Scenarios with Prior Regularization
    Bernal, Edgar A.
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2631 - 2641
  • [8] Cover Reproducible Steganography via Deep Generative Models
    Chen, Kejiang
    Zhou, Hang
    Wang, Yaofei
    Li, Menghan
    Zhang, Weiming
    Yu, Nenghai
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (05) : 3787 - 3798
  • [9] Deep View Synthesis via Self-Consistent Generative Network
    Liu, Zhuoman
    Jia, Wei
    Yang, Ming
    Luo, Peiyao
    Guo, Yong
    Tan, Mingkui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 451 - 465
  • [10] Multimodal and multicontrast image fusion via deep generative models
    Dimitri, Giovanna Maria
    Spasov, Simeon
    Duggento, Andrea
    Passamonti, Luca
    Lio, Pietro
    Toschi, Nicola
    INFORMATION FUSION, 2022, 88 : 146 - 160