Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Improvement of the signal-to-noise ratio in interferometry using multi-frame high-dynamic-range and normalization algorithms
    Restrepo, Rene
    Uribe-Patarroyo, Nestor
    Belenguer, Tomas
    OPTICS COMMUNICATIONS, 2012, 285 (05) : 546 - 552
  • [22] High-Fidelity Imaging Using Compact Multi-Frame Blind Deconvolution
    Douglas A. Hope
    Stuart M. Jefferies
    Cody Smith
    The Journal of the Astronautical Sciences, 2019, 66 : 162 - 169
  • [23] Single-pixel imaging of dynamic objects using multi-frame motion estimation
    Sagi Monin
    Evgeny Hahamovich
    Amir Rosenthal
    Scientific Reports, 11
  • [24] Multi-Frame Self-Supervised Depth Estimation with Multi-Scale Feature Fusion in Dynamic Scenes
    Zhong, Jiquan
    Huang, Xiaolin
    Yu, Xiao
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 2553 - 2563
  • [25] Deep High Dynamic Range Imaging of Dynamic Scenes
    Kalantari, Nima Khademi
    Ramamoorthi, Ravi
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [26] Multi-frame sparse feature extraction for lip-reading
    Lee, MJ
    Lee, SY
    Lee, KD
    PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON NEURAL NETWORKS AND BRAIN, VOLS 1-3, 2005, : 1943 - 1947
  • [27] Feature extraction method of multi-frame image in cloud video
    Cheng S.
    Diao S.
    Cai S.
    Liu H.
    International Journal of Information and Communication Technology, 2022, 20 (02) : 151 - 163
  • [28] High dynamic range imaging via gradient-aware context aggregation network
    Yan, Qingsen
    Gong, Dong
    Shi, Javen Qinfeng
    Hengel, Anton van den
    Sun, Jinqiu
    Zhu, Yu
    Zhang, Yanning
    PATTERN RECOGNITION, 2022, 122
  • [29] Multi-scale Dense Networks for Deep High Dynamic Range Imaging
    Yan, Qingsen
    Gong, Dong
    Zhang, Pingping
    Shi, Qinfeng
    Sun, Jinqiu
    Reid, Ian
    Zhang, Yanning
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 41 - 50
  • [30] DISENTANGLED FEATURE-GUIDED MULTI-EXPOSURE HIGH DYNAMIC RANGE IMAGING
    Lee, Keuntek
    Jang, Yeong Il
    Cho, Nam Ik
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2465 - 2469