Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Multi-frame Detection Method for Distributed Radar Network
    Wang, Jinghe
    Yi, Wei
    Kong, Lingjiang
    Guo, Shisheng
    2018 IEEE RADAR CONFERENCE (RADARCONF18), 2018, : 880 - 884
  • [32] Adaptive Frame Sampling and Feature Alignment for Multi-Frame Infrared Small Target Detection
    Yao, Chuanhong
    Zhao, Haitao
    APPLIED SCIENCES-BASEL, 2024, 14 (14):
  • [33] High Dynamic Range Image Compression Based on a Multi-Scale Feature Network
    Liu, Yabo
    Yang, Xiaoquan
    Jiang, Tao
    LASER & OPTOELECTRONICS PROGRESS, 2025, 62 (04)
  • [34] Complex scene video frames alignment and multi-frame fusion deraining with deep neural network
    Rui Su
    Lupeng Zhang
    Yuming Zhang
    Fengqiang Xu
    Kun Lu
    Ning Tong
    Fengqi Li
    Neural Computing and Applications, 2023, 35 : 5369 - 5380
  • [35] Complex scene video frames alignment and multi-frame fusion deraining with deep neural network
    Su, Rui
    Zhang, Lupeng
    Zhang, Yuming
    Xu, Fengqiang
    Lu, Kun
    Tong, Ning
    Li, Fengqi
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (07): : 5369 - 5380
  • [36] Dynamic Video Image Segmentation Based on Dual Channel Convolutional Kernel and Multi-Frame Feature Fusion
    Chen, Zuguo
    Chen, Chaoyang
    Lu, Ming
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [37] Deep Reparametrization of Multi-Frame Super-Resolution and Denoising
    Bhat, Goutam
    Danelljan, Martin
    Yu, Fisher
    Van Gool, Luc
    Timofte, Radu
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2440 - 2450
  • [38] A Lightweight Network for High Dynamic Range Imaging
    Yan, Qingsen
    Zhang, Song
    Chen, Weiye
    Liu, Yuhang
    Zhang, Zhen
    Zhang, Yanning
    Shi, Javen Qinfeng
    Gong, Dong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 823 - 831
  • [39] Multi-frame feature-fusion-based model for violence detection
    Asad, Mujtaba
    Yang, Jie
    He, Jiang
    Shamsolmoali, Pourya
    He, Xiangjian
    VISUAL COMPUTER, 2021, 37 (06): : 1415 - 1431
  • [40] Multi-frame feature-fusion-based model for violence detection
    Mujtaba Asad
    Jie Yang
    Jiang He
    Pourya Shamsolmoali
    Xiangjian He
    The Visual Computer, 2021, 37 : 1415 - 1431