High dynamic range imaging via gradient-aware context aggregation network

被引:23
|
作者
Yan, Qingsen [1 ]
Gong, Dong [1 ]
Shi, Javen Qinfeng [1 ]
Hengel, Anton van den [1 ]
Sun, Jinqiu [2 ]
Zhu, Yu [2 ]
Zhang, Yanning [2 ]
机构
[1] Univ Adelaide, Adelaide, SA 5005, Australia
[2] Northwestern Polytech Univ, Xian, Peoples R China
关键词
High dynamic range imaging; Deep learning; Exposure fusion; Ghosting artifacts; Image gradients; IMAGES;
D O I
10.1016/j.patcog.2021.108342
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Obtaining a high dynamic range (HDR) image from multiple low dynamic range images with different ex-posures is an important step in various computer vision tasks. One of the ongoing challenges in the field is to generate HDR images without ghosting artifacts. Motivated by an observation that such artifacts are particularly noticeable in the gradient domain, in this paper, we propose an HDR imaging approach that aggregates the information from multiple LDR images with guidance from image gradient domain. The proposed method generates artifact-free images by integrating the image gradient information and the image context information in the pixel domain. The context information in a large area helps to re-construct the contents contaminated by saturation and misalignments. Specifically, an additional gradient stream and the supervision in the gradient domain are applied to incorporate the gradient information in HDR imaging. To use the context information captured from a large area while preserving spatial resolu-tion, we adopt dilated convolutions to extract multi-scale features with rich context information. More -over, we build a new dataset containing 40 groups of real-world images from diverse scenes with ground truth to validate the proposed model. The samples in the proposed dataset include more challenging moving objects inducing misalignments. Extensive experimental results demonstrate that our proposed model outperforms previous methods on different datasets in terms of both quantitative measure and visual perception quality. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Multispectral high dynamic range imaging
    Brauers, Johannes
    Schulte, Nils
    Bell, Andre A.
    Aach, Til
    COLOR IMAGING XIII: PROCESSING, HARDCOPY, AND APPLICATIONS, 2008, 6807
  • [42] High Dynamic Range Imaging Technology
    Artusi, Alessandro
    Richter, Thomas
    Ebrahimi, Touradj
    Mantiuk, Rafal K.
    IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (05) : 165 - 172
  • [43] Foreword - High dynamic range imaging
    Santos, Luis Paulo
    Debattista, Kurt
    COMPUTERS & GRAPHICS-UK, 2013, 37 (07): : A11 - A12
  • [44] High Dynamic Range Fluorescence Imaging
    Vinegoni, Claudio
    Feruglio, Paolo Fumene
    Weissleder, Ralph
    IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2019, 25 (01)
  • [45] HIGH DYNAMIC-RANGE IMAGING
    PERLEY, RA
    SYNTHESIS IMAGING IN RADIO ASTRONOMY, 1989, 6 : 287 - 313
  • [46] High dynamic range ultrasound imaging
    Alperen Degirmenci
    Douglas P. Perrin
    Robert D. Howe
    International Journal of Computer Assisted Radiology and Surgery, 2018, 13 : 721 - 729
  • [47] High dynamic range astronomical imaging
    Olson, Thor
    FIFTEENTH COLOR IMAGING CONFERENCE: COLOR SCIENCE AND ENGINEERING SYSTEMS, TECHNOLOGIES, AND APPLICATIONS, FINAL PROGRAM AND PROCEEDINGS, 2007, : 304 - 312
  • [48] Super High Dynamic Range Imaging
    Hayami, Takehito
    Tanaka, Masayuki
    Okutomi, Masatoshi
    Shibata, Takashi
    Senda, Shuji
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 720 - 725
  • [49] Streamed High Dynamic Range Imaging
    Bailey, Donald G.
    2012 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (FPT'12), 2012, : 305 - 308
  • [50] High dynamic range ultrasound imaging
    Degirmenci, Alperen
    Perrin, Douglas P.
    Howe, Robert D.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2018, 13 (05) : 721 - 729