Using Deep Neural Networks for Inverse Problems in Imaging Beyond analytical methods

被引:350
|
作者
Lucas, Alice [1 ,2 ]
Iliadis, Michael [3 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [1 ,5 ]
机构
[1] Northwestern Univ, Elect Engn & Comp Sci Dept, Evanston, IL 60208 USA
[2] Image & Video Proc Lab, Evanston, IL 60208 USA
[3] Sony US Res Ctr, San Jose, CA USA
[4] Univ Granada, Comp Sci & Artificial Intelligence, Granada, Spain
[5] Northwestern Univ, Elect Engn & Comp Sci, Evanston, IL 60208 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/MSP.2017.2760358
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Traditionally, analytical methods have been used to solve imaging problems such as image restoration, inpainting, and superresolution (SR). In recent years, the fields of machine and deep learning have gained a lot of momentum in solving such imaging problems, often surpassing the performance provided by analytical approaches. Unlike analytical methods for which the problem is explicitly defined and domain-knowledge carefully engineered into the solution, deep neural networks (DNNs) do not benefit from such prior knowledge and instead make use of large data sets to learn the unknown solution to the inverse problem. In this article, we review deep-learning techniques for solving such inverse problems in imaging. More specifically, we review the popular neural network architectures used for imaging tasks, offering some insight as to how these deep-learning tools can solve the inverse problem. Furthermore, we address some fundamental questions, such as how deeplearning and analytical methods can be combined to provide better solutions to the inverse problem in addition to providing a discussion on the current limitations and future directions of the use of deep learning for solving inverse problem in imaging. © 2017 IEEE.
引用
收藏
页码:20 / 36
页数:17
相关论文
共 50 条
  • [21] Solution of Inverse Problems in Electromagnetic NDT Using Neural Networks
    Ayad, Abdelghani
    Benhamida, Farid
    Bendaoud, Abdelber
    Le Bihan, Yann
    Bensetti, Mohamed
    PRZEGLAD ELEKTROTECHNICZNY, 2011, 87 (9A): : 330 - 333
  • [22] SOLUTION OF INVERSE PROBLEMS IN ELECTROMAGNETICS USING HOPFIELD NEURAL NETWORKS
    ELSHAFIEY, I
    UDPA, L
    UDPA, SS
    IEEE TRANSACTIONS ON MAGNETICS, 1995, 31 (01) : 852 - 861
  • [23] Deep learning methods for inverse problems
    Kamyab, Shima
    Azimifar, Zohreh
    Sabzi, Rasool
    Fieguth, Paul
    PEERJ COMPUTER SCIENCE, 2022, 8
  • [24] Deep Learning for Inverse Problems in Imaging
    Ates, Hasan F.
    2019 NINTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2019,
  • [25] Equivariant neural networks for inverse problems
    Celledoni, Elena
    Ehrhardt, Matthias J.
    Etmann, Christian
    Owren, Brynjulf
    Schonlieb, Carola-Bibiane
    Sherry, Ferdia
    INVERSE PROBLEMS, 2021, 37 (08)
  • [26] Neural networks for quantum inverse problems
    Cao, Ningping
    Xie, Jie
    Zhang, Aonan
    Hou, Shi-Yao
    Zhang, Lijian
    Zeng, Bei
    NEW JOURNAL OF PHYSICS, 2022, 24 (06):
  • [27] Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks
    Liang, Dong
    Cheng, Jing
    Ke, Ziwen
    Ying, Leslie
    IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (01) : 141 - 151
  • [28] Beyond the hype: deep neural networks outperform established methods using a ChEMBL bioactivity benchmark set
    Eelke B. Lenselink
    Niels ten Dijke
    Brandon Bongers
    George Papadatos
    Herman W. T. van Vlijmen
    Wojtek Kowalczyk
    Adriaan P. IJzerman
    Gerard J. P. van Westen
    Journal of Cheminformatics, 9
  • [29] Beyond the hype: deep neural networks outperform established methods using a ChEMBL bioactivity benchmark set
    Lenselink, Eelke B.
    ten Dijke, Niels
    Bongers, Brandon
    Papadatos, George
    van Vlijmen, Herman W. T.
    Kowalczyk, Wojtek
    IJzerman, Adriaan P.
    van Westen, Gerard J. P.
    JOURNAL OF CHEMINFORMATICS, 2017, 9
  • [30] USING DEEP LEARNING NEURAL NETWORKS FOR INVERSE PROTEIN FOLDING PREDICTIONS
    La Fleur, Alyssa
    Almaw, Tersa
    Ojennus, Deanna
    Jones, Kent
    PROTEIN SCIENCE, 2019, 28 : 139 - 139