End-to-End Learning for Image Burst Deblurring

被引:7
|
作者
Wieschollek, Patrick [1 ,2 ]
Schoelkopf, Bernhard [1 ]
Lensch, Hendrik P. A. [2 ]
Hirsch, Michael [1 ]
机构
[1] Max Planck Inst Intelligent Syst, Stuttgart, Germany
[2] Univ Tubingen, Tubingen, Germany
来源
关键词
This work has been partially supported by the DFG Emmy Noether fellowship Le 1341/1-1 and an NVIDIA hardware grant;
D O I
10.1007/978-3-319-54190-7_3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a neural network model approach for multi-frame blind deconvolution. The discriminative approach adopts and combines two recent techniques for image deblurring into a single neural network architecture. Our proposed hybrid-architecture combines the explicit prediction of a deconvolution filter and non-trivial averaging of Fourier coefficients in the frequency domain. In order to make full use of the information contained in all images in one burst, the proposed network embeds smaller networks, which explicitly allow the model to transfer information between images in early layers. Our system is trained end-to-end using standard backpropagation on a set of artificially generated training examples, enabling competitive performance in multi-frame blind deconvolution, both with respect to quality and runtime.
引用
下载
收藏
页码:35 / 51
页数:17
相关论文
共 50 条
  • [31] Modal Contrastive Learning Based End-to-End Text Image Machine Translation
    Ma, Cong
    Han, Xu
    Wu, Linghui
    Zhang, Yaping
    Zhao, Yang
    Zhou, Yu
    Zong, Chengqing
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 2153 - 2165
  • [32] End-to-end learning for image-based air quality level estimation
    Zhang, Chao
    Yan, Junchi
    Li, Changsheng
    Wu, Hao
    Bie, Rongfang
    MACHINE VISION AND APPLICATIONS, 2018, 29 (04) : 601 - 615
  • [33] End-to-end learning for image-based air quality level estimation
    Chao Zhang
    Junchi Yan
    Changsheng Li
    Hao Wu
    Rongfang Bie
    Machine Vision and Applications, 2018, 29 : 601 - 615
  • [34] End-to-End Deep Learning CT Image Reconstruction for Metal Artifact Reduction
    Bauer, Dominik F.
    Ulrich, Constantin
    Russ, Tom
    Golla, Alena-Kathrin
    Schad, Lothar R.
    Zoellner, Frank G.
    APPLIED SCIENCES-BASEL, 2022, 12 (01):
  • [35] An End-to-End Image Retrieval System Based on Gravitational Field Deep Learning
    Zheng, Qinghe
    Yang, Mingqiang
    Zhang, Qingrui
    Zhang, Xinxin
    Yang, Jiajie
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 936 - 940
  • [36] Unified medical image segmentation by learning from uncertainty in an end-to-end manner
    Tang, Pin
    Yang, Pinli
    Nie, Dong
    Wu, Xi
    Zhou, Jiliu
    Wang, Yan
    KNOWLEDGE-BASED SYSTEMS, 2022, 241
  • [37] End-to-end learning for joint depth and image reconstruction from diffracted rotation
    Mel, Mazen
    Siddiqui, Muhammad
    Zanuttigh, Pietro
    VISUAL COMPUTER, 2024, 40 (09): : 5961 - 5977
  • [38] End-to-End Versatile Human Activity Recognition with Activity Image Transfer Learning
    Ye, Yalan
    Liu, Ziqi
    Huang, Ziwei
    Pan, Tongjie
    Wan, Zhengyi
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 1128 - 1131
  • [39] Image-tag-based indoor localization using end-to-end learning
    Alarfaj, Mohammed
    Su, Zhenqiang
    Liu, Raymond
    Al-Humam, Abdulaziz
    Liu, Huaping
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2021, 17 (11):
  • [40] CNN and Deep Sets for End-to-End Whole Slide Image Representation Learning
    Hemati, Sobhan
    Kalra, Shivam
    Meaney, Cameron
    Babaie, Morteza
    Ghodsi, Ali
    Tizhoosh, H. R.
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 143, 2021, 143 : 301 - 311