Convolutional Neural Networks for Inverse Problems in Imaging A review

被引:433
|
作者
McCann, Michael T. [1 ,2 ]
Jin, Kyong Hwan [3 ,4 ]
Unser, Michael [4 ,5 ,6 ,7 ,8 ]
机构
[1] Ecole Polytech Fed Lausanne, Lab Imagerie Biomed, Lausanne, Switzerland
[2] Ecole Polytech Fed Lausanne, Ctr Imagerie Biomed, Lausanne, Switzerland
[3] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[4] Ecole Polytech Fed Lausanne, Biomed Imaging Grp, Lausanne, Switzerland
[5] IEEE Signal Proc Soc SPS, Tech Comm Bioimaging & Signal Proc, Piscataway, NJ USA
[6] EURASIP, Munich, Germany
[7] Swiss Acad Engn Sci, Paris, France
[8] IEEE, New York, NY USA
基金
欧盟地平线“2020”;
关键词
RECONSTRUCTION;
D O I
10.1109/MSP.2017.2739299
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we review recent uses of convolutional neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding performance on object classification and segmentation tasks. Motivated by these successes, researchers have begun to apply CNNs to the resolution of inverse problems such as denoising, deconvolution, super-resolution, and medical image reconstruction, and they have started to report improvements over state-of-the-art methods, including sparsity-based techniques such as compressed sensing. Here, we review the recent experimental work in these areas, with a focus on the critical design decisions: From where do the training data come? What is the architecture of the CNN? How is the learning problem formulated and solved? We also mention a few key theoretical papers that offer perspectives on why CNNs are appropriate for inverse problems, and we point to some next steps in the field.
引用
收藏
页码:85 / 95
页数:11
相关论文
共 50 条
  • [1] Deep Convolutional Neural Network for Inverse Problems in Imaging
    Jin, Kyong Hwan
    McCann, Michael T.
    Froustey, Emmanuel
    Unser, Michael
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) : 4509 - 4522
  • [2] CONVOLUTIONAL NEURAL NETWORKS IN PHASE SPACE AND INVERSE PROBLEMS
    Uhlmann, Gunther
    Wang, Yiran
    [J]. SIAM JOURNAL ON APPLIED MATHEMATICS, 2020, 80 (06) : 2560 - 2585
  • [3] Convolutional Neural Networks for Multifrequency Electromagnetic Inverse Problems
    Li, Hao
    Chen, Lijia
    Qiu, Jinghui
    [J]. IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2021, 20 (08): : 1424 - 1428
  • [4] Multi-resolution convolutional neural networks for inverse problems
    Wang, Feng
    Eljarrat, Alberto
    Mueller, Johannes
    Henninen, Trond R.
    Erni, Rolf
    Koch, Christoph T.
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [5] Multi-resolution convolutional neural networks for inverse problems
    Feng Wang
    Alberto Eljarrat
    Johannes Müller
    Trond R. Henninen
    Rolf Erni
    Christoph T. Koch
    [J]. Scientific Reports, 10
  • [6] Convolutional Neural Networks in Medical Imaging: A Review
    Lin, Anjie
    Su, Bianping
    Ning, Yihe
    Zhang, Longqing
    He, Yantao
    [J]. ADVANCES IN SWARM INTELLIGENCE, PT II, ICSI 2024, 2024, 14789 : 419 - 430
  • [7] Neural Networks for Inverse Problems: the Microwave Imaging Case
    Franceschini, S.
    Ambrosanio, M.
    Baselice, F.
    Pascazio, V
    [J]. 2021 15TH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION (EUCAP), 2021,
  • [8] Uncertainty Quantification in Inverse Scattering Problems With Bayesian Convolutional Neural Networks
    Wei, Zhun
    Chen, Xudong
    [J]. IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2021, 69 (06) : 3409 - 3418
  • [9] Neural networks for inverse problems in damage identification and optical imaging
    Kim, YY
    Kapania, RK
    [J]. AIAA JOURNAL, 2003, 41 (04) : 732 - 740
  • [10] Role of Convolutional Neural Networks in Hyperspectral Imaging Applications: A Review
    Lanke, Neha P.
    Chandak, M. B.
    [J]. FOURTH CONGRESS ON INTELLIGENT SYSTEMS, VOL 2, CIS 2023, 2024, 869 : 201 - 207