High dynamic range imaging via gradient-aware context aggregation network

被引:23
|
作者
Yan, Qingsen [1 ]
Gong, Dong [1 ]
Shi, Javen Qinfeng [1 ]
Hengel, Anton van den [1 ]
Sun, Jinqiu [2 ]
Zhu, Yu [2 ]
Zhang, Yanning [2 ]
机构
[1] Univ Adelaide, Adelaide, SA 5005, Australia
[2] Northwestern Polytech Univ, Xian, Peoples R China
关键词
High dynamic range imaging; Deep learning; Exposure fusion; Ghosting artifacts; Image gradients; IMAGES;
D O I
10.1016/j.patcog.2021.108342
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Obtaining a high dynamic range (HDR) image from multiple low dynamic range images with different ex-posures is an important step in various computer vision tasks. One of the ongoing challenges in the field is to generate HDR images without ghosting artifacts. Motivated by an observation that such artifacts are particularly noticeable in the gradient domain, in this paper, we propose an HDR imaging approach that aggregates the information from multiple LDR images with guidance from image gradient domain. The proposed method generates artifact-free images by integrating the image gradient information and the image context information in the pixel domain. The context information in a large area helps to re-construct the contents contaminated by saturation and misalignments. Specifically, an additional gradient stream and the supervision in the gradient domain are applied to incorporate the gradient information in HDR imaging. To use the context information captured from a large area while preserving spatial resolu-tion, we adopt dilated convolutions to extract multi-scale features with rich context information. More -over, we build a new dataset containing 40 groups of real-world images from diverse scenes with ground truth to validate the proposed model. The samples in the proposed dataset include more challenging moving objects inducing misalignments. Extensive experimental results demonstrate that our proposed model outperforms previous methods on different datasets in terms of both quantitative measure and visual perception quality. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] High Dynamic Range Imaging with Context-aware Transformer
    Zhou, Fangfang
    Fu, Zhengming
    Zhang, Dan
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [2] High Dynamic Range Imaging Based on Coherence-Aware Feature Aggregation
    Yin, Jia-Li
    Han, Jin
    Chen, Bin
    Liu, Xi-Meng
    Jisuanji Xuebao/Chinese Journal of Computers, 2024, 47 (10): : 2352 - 2367
  • [3] Ghost-free High Dynamic Range Imaging with Context-Aware Transformer
    Liu, Zhen
    Wang, Yinglong
    Zeng, Bing
    Liu, Shuaicheng
    COMPUTER VISION, ECCV 2022, PT XIX, 2022, 13679 : 344 - 360
  • [4] Multi-level Feature Aggregation Network for High Dynamic Range Imaging
    Xiao, Jun
    Lam, Kin-Man
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [5] GCPNet: Gradient-aware channel pruning network with bilateral coupled sampling strategy
    Zhang, Ziyang
    Cao, Chuqing
    Zheng, Fangjun
    Sun, Tao
    Zhao, Lijun
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266
  • [6] SCENE-AWARE HIGH DYNAMIC RANGE IMAGING
    Chen, Wei-Ren
    Lee, Chuan-Ren
    Chiang, Jui-Chiu
    2015 23RD EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2015, : 609 - 613
  • [7] A Lightweight Network for High Dynamic Range Imaging
    Yan, Qingsen
    Zhang, Song
    Chen, Weiye
    Liu, Yuhang
    Zhang, Zhen
    Zhang, Yanning
    Shi, Javen Qinfeng
    Gong, Dong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 823 - 831
  • [8] Deep progressive feature aggregation network for multi-frame high dynamic range imaging
    Xiao, Jun
    Ye, Qian
    Liu, Tianshan
    Zhang, Cong
    Lam, Kin-Man
    NEUROCOMPUTING, 2024, 594
  • [9] GUFORMER: a gradient-aware U-shaped transformer neural network for real image denoising
    Bai, Xuefei
    Wan, Yongsong
    Wang, Weiming
    Zhou, Bin
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [10] Gradient-aware channel attention network for infrared small target image denoising before detection
    Lin, Zai-Ping
    Luo, Yi-Hang
    Li, Bo-Yang
    Ling, Qiang
    Zheng, Qing
    Yang, Jing-Yi
    Liu, Li
    Wu, Jing
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2024, 43 (02) : 254 - 260