Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Deep Photometric Stereo Network with Multi-Scale Feature Aggregation
    Yu, Chanki
    Lee, Sang Wook
    SENSORS, 2020, 20 (21) : 1 - 14
  • [42] DEEP MULTI-FRAME MVDR FILTERING FOR BINAURAL NOISE REDUCTION
    Tammen, Marvin
    Doclo, Simon
    2022 INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC 2022), 2022,
  • [43] Robust Visual Tracking Using Multi-Frame Multi-Feature Joint Modeling
    Zhang, Peng
    Yu, Shujian
    Xu, Jiamiao
    You, Xinge
    Jiang, Xiubao
    Jing, Xiao-Yuan
    Tao, Dacheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (12) : 3673 - 3686
  • [44] Dynamic multi-frame multi-spreading factor scheduling algorithm for LoRaWAN
    Eva I. Shayo
    Abdi T. Abdalla
    Alfred J. Mwambela
    Journal of Electrical Systems and Information Technology, 10 (1)
  • [45] Multi-frame Recurrent Adversarial Network for Moving Object Segmentation
    Patil, Prashant W.
    Dudhane, Akshay
    Murala, Subrahmanyam
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2301 - 2310
  • [46] Multi-frame Network Feature Fusion Model andSelf-attention Mechanism for Vehicle Lane Line Detection
    Zhu, Guang
    Liu, Yajuan
    Wang, Jiyue
    COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2024, 21 (04)
  • [47] Multi-exposure high dynamic range imaging with informative content enhanced network
    Zhiyong Pan
    Mei Yu
    Gangyi Jiang
    Haiyong Xu
    Zongju Peng
    Fen Chen
    NEUROCOMPUTING, 2020, 386 (386) : 147 - 164
  • [48] Multi-frame multi-exposure shock wave imaging and pressure measurements
    Mur, Jaka
    Reuter, Fabian
    Kocica, Jernej Jan
    Lokar, Ziga
    Petelin, Jaka
    Agrez, Vid
    Ohl, Claus-Dieter
    Petkovsek, Rok
    OPTICS EXPRESS, 2022, 30 (21): : 37664 - 37674
  • [49] A single frame and multi-frame joint network for 360-degree panorama video
    Liu, Hongying
    Ma, Wanhao
    Ruan, Zhubo
    Fang, Chaowei
    Shang, Fanhua
    Liu, Yuanyuan
    Wang, Lijun
    Wang, Chaoli
    Jiang, Dongmei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 134
  • [50] A High-frame-rate High Dynamic Range Imaging from Virtual Multi-thread Automatic Exposures
    Jiang, Xianwu
    Gu, Qingyi
    Aoyama, Tadayoshi
    Takaki, Takeshi
    Ishii, Idaku
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 1401 - 1406