Using Deep Neural Networks for Inverse Problems in Imaging Beyond analytical methods

被引:350
|
作者
Lucas, Alice [1 ,2 ]
Iliadis, Michael [3 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [1 ,5 ]
机构
[1] Northwestern Univ, Elect Engn & Comp Sci Dept, Evanston, IL 60208 USA
[2] Image & Video Proc Lab, Evanston, IL 60208 USA
[3] Sony US Res Ctr, San Jose, CA USA
[4] Univ Granada, Comp Sci & Artificial Intelligence, Granada, Spain
[5] Northwestern Univ, Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/MSP.2017.2760358
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditionally, analytical methods have been used to solve imaging problems such as image restoration, inpainting, and superresolution (SR). In recent years, the fields of machine and deep learning have gained a lot of momentum in solving such imaging problems, often surpassing the performance provided by analytical approaches. Unlike analytical methods for which the problem is explicitly defined and domain-knowledge carefully engineered into the solution, deep neural networks (DNNs) do not benefit from such prior knowledge and instead make use of large data sets to learn the unknown solution to the inverse problem. In this article, we review deep-learning techniques for solving such inverse problems in imaging. More specifically, we review the popular neural network architectures used for imaging tasks, offering some insight as to how these deep-learning tools can solve the inverse problem. Furthermore, we address some fundamental questions, such as how deeplearning and analytical methods can be combined to provide better solutions to the inverse problem in addition to providing a discussion on the current limitations and future directions of the use of deep learning for solving inverse problem in imaging. © 2017 IEEE.
引用
收藏
页码:20 / 36
页数:17
相关论文
共 50 条
  • [31] Deep Neural Networks with Spacetime RBF for Solving Forward and Inverse Problems in the Diffusion Process
    Ku, Cheng-Yu
    Liu, Chih-Yu
    Chiu, Yu-Jia
    Chen, Wei-Da
    MATHEMATICS, 2024, 12 (09)
  • [33] Deep Equilibrium Architectures for Inverse Problems in Imaging
    Gilton, Davis
    Ongie, Gregory
    Willett, Rebecca
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 1123 - 1133
  • [34] STOCHASTIC DEEP UNFOLDING FOR IMAGING INVERSE PROBLEMS
    Liu, Jiaming
    Sun, Yu
    Gan, Weijie
    Xu, Xiaojian
    Wohlberg, Brendt
    Kamilov, Ulugbek S.
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1395 - 1399
  • [35] Quadratic Neural Networks for Solving Inverse Problems
    Frischauf, Leon
    Scherzer, Otmar
    Shi, Cong
    NUMERICAL FUNCTIONAL ANALYSIS AND OPTIMIZATION, 2024, 45 (02) : 112 - 135
  • [36] APPLICATION OF NEURAL NETWORKS TO INVERSE PROBLEMS IN ELECTROMAGNETICS
    ELSHAFIEY, I
    UDPA, LI
    UDPA, SS
    IEEE TRANSACTIONS ON MAGNETICS, 1994, 30 (05) : 3629 - 3632
  • [37] Cycle-Consistency-Based Uncertainty Quantification of Neural Networks in Inverse Imaging Problems
    Huang, Luzhe
    Li, Jianing
    Ding, Xiaofu
    Zhang, Yijie
    Chen, Hanlong
    Ozcan, Aydogan
    Intelligent Computing, 2023, 2
  • [38] Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks
    Ondruska, Peter
    Posner, Ingmar
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 3361 - 3367
  • [39] ON ANALYTICAL METHODS IN THE THEORY OF INVERSE PROBLEMS OF MATHEMATICAL PHYSICS
    Anikonov, Y. E.
    Neshchadim, M. V.
    SIBERIAN ELECTRONIC MATHEMATICAL REPORTS-SIBIRSKIE ELEKTRONNYE MATEMATICHESKIE IZVESTIYA, 2010, 7 : C11 - C61
  • [40] Analytical methods of the theory of inverse problems for parabolic equations
    Anikonov Y.E.
    Neshchadim M.V.
    Journal of Mathematical Sciences, 2013, 195 (6) : 754 - 770