Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multi-level Feature Aggregation Network for High Dynamic Range Imaging
    Xiao, Jun
    Lam, Kin-Man
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [2] A Deep Multi-Frame Super-Resolution Network for Dynamic Scenes
    Pan, Ze
    Tan, Zheng
    Lv, Qunbo
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [3] Multi-scale Progressive Reconstruction Network for High Dynamic Range Imaging
    Qi, Ying
    Li, Qiushi
    Li, Jian
    Huang, Zhaoyuan
    Wan, Teng
    Zh, Qiang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VIII, 2025, 15038 : 568 - 582
  • [4] Multi-Frame Content-Aware Mapping Network for Standard-Dynamic-Range to High-Dynamic-Range Television Artifact Removal
    Wang, Zheng
    He, Gang
    SENSORS, 2024, 24 (01)
  • [5] Progressive and Selective Fusion Network for High Dynamic Range Imaging
    Ye, Qian
    Xiao, Jun
    Lam, Kin-man
    Okatani, Takayuki
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5290 - 5297
  • [6] Sensor-realistic Synthetic Data Engine for Multi-frame High Dynamic Range Photography
    Hu, Jinhan
    Choe, Gyeongmin
    Nadir, Zeeshan
    Nabil, Osama
    Lee, Seok-Jun
    Sheikh, Hamid
    Yoo, Youngjun
    Polley, Michael
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2180 - 2189
  • [7] Multi-Frame Feature Aggregation for Real-Time Instrument Segmentation in Endoscopic Video
    Lin, Shan
    Qin, Fangbo
    Peng, Haonan
    Bly, Randall A.
    Moe, Kris S.
    Hannaford, Blake
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6773 - 6780
  • [8] High Dynamic Range Imaging Based on Coherence-Aware Feature Aggregation
    Yin, Jia-Li
    Han, Jin
    Chen, Bin
    Liu, Xi-Meng
    Jisuanji Xuebao/Chinese Journal of Computers, 2024, 47 (10): : 2352 - 2367
  • [9] Visual Odometry by Multi-frame Feature Integration
    Badino, Hernan
    Yamamoto, Akihiro
    Kanade, Takeo
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2013, : 222 - 229
  • [10] AWFA-LPD: Adaptive Weight Feature Aggregation for Multi-frame License Plate Detection
    Lu, Xiaocheng
    Yuan, Yuan
    Wang, Qi
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 476 - 480