Using Deep Neural Networks for Inverse Problems in Imaging Beyond analytical methods

被引:350
|
作者
Lucas, Alice [1 ,2 ]
Iliadis, Michael [3 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [1 ,5 ]
机构
[1] Northwestern Univ, Elect Engn & Comp Sci Dept, Evanston, IL 60208 USA
[2] Image & Video Proc Lab, Evanston, IL 60208 USA
[3] Sony US Res Ctr, San Jose, CA USA
[4] Univ Granada, Comp Sci & Artificial Intelligence, Granada, Spain
[5] Northwestern Univ, Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/MSP.2017.2760358
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditionally, analytical methods have been used to solve imaging problems such as image restoration, inpainting, and superresolution (SR). In recent years, the fields of machine and deep learning have gained a lot of momentum in solving such imaging problems, often surpassing the performance provided by analytical approaches. Unlike analytical methods for which the problem is explicitly defined and domain-knowledge carefully engineered into the solution, deep neural networks (DNNs) do not benefit from such prior knowledge and instead make use of large data sets to learn the unknown solution to the inverse problem. In this article, we review deep-learning techniques for solving such inverse problems in imaging. More specifically, we review the popular neural network architectures used for imaging tasks, offering some insight as to how these deep-learning tools can solve the inverse problem. Furthermore, we address some fundamental questions, such as how deeplearning and analytical methods can be combined to provide better solutions to the inverse problem in addition to providing a discussion on the current limitations and future directions of the use of deep learning for solving inverse problem in imaging. © 2017 IEEE.
引用
收藏
页码:20 / 36
页数:17
相关论文
共 50 条
  • [1] Solving coherent-imaging inverse problems using deep neural networks: An experimental demonstration
    Pellizzari, Casey J.
    Bate, Timothy J.
    Donnelly, Kevin P.
    Spencer, Mark F.
    UNCONVENTIONAL IMAGING AND ADAPTIVE OPTICS 2022, 2022, 12239
  • [2] Deep Convolutional Neural Network for Inverse Problems in Imaging
    Jin, Kyong Hwan
    McCann, Michael T.
    Froustey, Emmanuel
    Unser, Michael
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) : 4509 - 4522
  • [3] NETT: solving inverse problems with deep neural networks
    Li, Housen
    Schwab, Johannes
    Antholzer, Stephan
    Haltmeier, Markus
    INVERSE PROBLEMS, 2020, 36 (06)
  • [4] Neural Networks for Inverse Problems: the Microwave Imaging Case
    Franceschini, S.
    Ambrosanio, M.
    Baselice, F.
    Pascazio, V
    2021 15TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION (EUCAP), 2021,
  • [5] Convolutional Neural Networks for Inverse Problems in Imaging A review
    McCann, Michael T.
    Jin, Kyong Hwan
    Unser, Michael
    IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) : 85 - 95
  • [6] Solving Inverse Problems With Deep Neural Networks - Robustness Included?
    Genzel, Martin
    Macdonald, Jan
    Marz, Maximilian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 1119 - 1134
  • [7] Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
    Lan, Shiwei
    Li, Shuyi
    Shahbaba, Babak
    SIAM-ASA JOURNAL ON UNCERTAINTY QUANTIFICATION, 2022, 10 (04): : 1684 - 1713
  • [8] Solving inverse problems in stochastic models using deep neural networks and adversarial training
    Xu, Kailai
    Darve, Eric
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2021, 384
  • [9] An Inner-loop Free Solution to Inverse Problems using Deep Neural Networks
    Fai, Kai
    Wei, Qi
    Carin, Lawrence
    Heller, Katherine
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [10] Solving ill-posed inverse problems using iterative deep neural networks
    Adler, Jonas
    Oktem, Ozan
    INVERSE PROBLEMS, 2017, 33 (12)