End-to-End Learning for Image Burst Deblurring

被引:7
|
作者
Wieschollek, Patrick [1 ,2 ]
Schoelkopf, Bernhard [1 ]
Lensch, Hendrik P. A. [2 ]
Hirsch, Michael [1 ]
机构
[1] Max Planck Inst Intelligent Syst, Stuttgart, Germany
[2] Univ Tubingen, Tubingen, Germany
来源
关键词
This work has been partially supported by the DFG Emmy Noether fellowship Le 1341/1-1 and an NVIDIA hardware grant;
D O I
10.1007/978-3-319-54190-7_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a neural network model approach for multi-frame blind deconvolution. The discriminative approach adopts and combines two recent techniques for image deblurring into a single neural network architecture. Our proposed hybrid-architecture combines the explicit prediction of a deconvolution filter and non-trivial averaging of Fourier coefficients in the frequency domain. In order to make full use of the information contained in all images in one burst, the proposed network embeds smaller networks, which explicitly allow the model to transfer information between images in early layers. Our system is trained end-to-end using standard backpropagation on a set of artificially generated training examples, enabling competitive performance in multi-frame blind deconvolution, both with respect to quality and runtime.
引用
收藏
页码:35 / 51
页数:17
相关论文
共 50 条
  • [21] Hyperspectral imaging from a raw mosaic image with end-to-end learning
    Fu, Hao
    Bian, Liheng
    Cao, Xianbin
    Zhang, Jun
    OPTICS EXPRESS, 2020, 28 (01) : 314 - 324
  • [22] End-to-End Supermask Pruning: Learning to Prune Image Captioning Models
    Tan, Jia Huei
    Chan, Chee Seng
    Chuah, Joon Huang
    PATTERN RECOGNITION, 2022, 122
  • [23] CPIPS: Learning to Preserve Perceptual Distances in End-to-End Image Compression
    Huang, Chen-Hsiu
    Wu, Ja-Ling
    2023 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2023, : 1705 - 1711
  • [24] Integrating Neural Networks Into the Blind Deblurring Framework to Compete With the End-to-End Learning-Based Methods
    Wu, Junde
    Di, Xiaoguang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6841 - 6851
  • [25] End-To-End Rotational Motion Deblurring Method Combining with Motion Information
    Qiu, Yudan
    Zhang, Cheng
    2020 4TH INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2020), 2020, 1518
  • [26] Tell, Imagine, and Search: End-to-end Learning for Composing Text and Image to Image Retrieval
    Zhang, Feifei
    Xu, Mingliang
    Xu, Changsheng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (02)
  • [27] End-to-end image quality assessment
    Raventos, Joaquin
    VISUAL INFORMATION PROCESSING XXI, 2012, 8399
  • [28] STATISTICAL LEARNING FOR END-TO-END SIMULATIONS
    Vicent, J.
    Verrelst, J.
    Rivera-Caicedo, J. P.
    Sabater, N.
    Munoz-Mari, J.
    Camps-Valls, G.
    Moreno, J.
    IGARSS 2018 - 2018 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2018, : 1699 - 1702
  • [29] END-TO-END LEARNING FOR MUSIC AUDIO
    Dieleman, Sander
    Schrauwen, Benjamin
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [30] Learning True Rate-Distortion-Optimization for End-To-End Image Compression
    Brand, Fabian
    Fischer, Kristian
    Kopte, Alexander
    Kaup, Andre
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 443 - 443