High dynamic range imaging via gradient-aware context aggregation network

被引:23
|
作者
Yan, Qingsen [1 ]
Gong, Dong [1 ]
Shi, Javen Qinfeng [1 ]
Hengel, Anton van den [1 ]
Sun, Jinqiu [2 ]
Zhu, Yu [2 ]
Zhang, Yanning [2 ]
机构
[1] Univ Adelaide, Adelaide, SA 5005, Australia
[2] Northwestern Polytech Univ, Xian, Peoples R China
关键词
High dynamic range imaging; Deep learning; Exposure fusion; Ghosting artifacts; Image gradients; IMAGES;
D O I
10.1016/j.patcog.2021.108342
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Obtaining a high dynamic range (HDR) image from multiple low dynamic range images with different ex-posures is an important step in various computer vision tasks. One of the ongoing challenges in the field is to generate HDR images without ghosting artifacts. Motivated by an observation that such artifacts are particularly noticeable in the gradient domain, in this paper, we propose an HDR imaging approach that aggregates the information from multiple LDR images with guidance from image gradient domain. The proposed method generates artifact-free images by integrating the image gradient information and the image context information in the pixel domain. The context information in a large area helps to re-construct the contents contaminated by saturation and misalignments. Specifically, an additional gradient stream and the supervision in the gradient domain are applied to incorporate the gradient information in HDR imaging. To use the context information captured from a large area while preserving spatial resolu-tion, we adopt dilated convolutions to extract multi-scale features with rich context information. More -over, we build a new dataset containing 40 groups of real-world images from diverse scenes with ground truth to validate the proposed model. The samples in the proposed dataset include more challenging moving objects inducing misalignments. Extensive experimental results demonstrate that our proposed model outperforms previous methods on different datasets in terms of both quantitative measure and visual perception quality. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Efficient High Dynamic Range Imaging via Matrix Completion
    Tsagkatakis, Grigorios
    Tsakalides, Panagiotis
    2012 IEEE INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2012,
  • [22] Gradient-aware trade-off control strategy dynamic optimization for a fuel cell hybrid electric vehicle
    Lin, Xinyou
    Huang, Hao
    Xie, Liping
    Zou, Songchun
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 81 : 1107 - 1120
  • [23] Graph context-attention network via low and high order aggregation
    Xu, Haiyun
    Zhang, Shaojie
    Jiang, Bo
    Tang, Jin
    NEUROCOMPUTING, 2023, 536 : 152 - 163
  • [24] High Dynamic Range Imaging
    Ebrahimi, Touradj
    Tescher, Andrew G.
    OPTICAL ENGINEERING, 2013, 52 (10)
  • [25] High dynamic range imaging
    Perley, RA
    SYNTHESIS IMAGING IN RADIO ASTRONOMY II, 1999, 180 : 275 - 299
  • [26] High dynamic range imaging
    Ward, G
    NINTH COLOR IMAGING CONFERENCE: COLOR SCIENCE AND ENGINEERING SYSTEMS, TECHNOLOGIES, APPLICATIONS, 2001, : 9 - 16
  • [27] High Dynamic Range Imaging
    Chaurasiya, Rahul Kumar
    Ramakrishnan, K. R.
    2013 INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT 2013), 2013, : 83 - 89
  • [28] Exposure-Structure Blending Network for High Dynamic Range Imaging of Dynamic Scenes
    Lee, Sang-Hoon
    Chung, Haesoo
    Cho, Nam Ik
    IEEE ACCESS, 2020, 8 : 117428 - 117438
  • [29] Gradient domain high dynamic range compression
    Fattal, R
    Lischinski, D
    Werman, M
    ACM TRANSACTIONS ON GRAPHICS, 2002, 21 (03): : 249 - 256
  • [30] High dynamic range display adopting high dynamic range imaging technique
    Cheng, Yu-Kuo
    Wan, Yu-Wen
    Shieh, Han-Ping D.
    2006 IEEE LEOS ANNUAL MEETING CONFERENCE PROCEEDINGS, VOLS 1 AND 2, 2006, : 715 - +