Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

被引:20
|
作者
Zheng, Zhuoran [1 ,2 ,3 ]
Ren, Wenqi [2 ,3 ]
Cao, Xiaochun [3 ]
Wang, Tao [4 ]
Jia, Xiuyi [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing, Peoples R China
[3] Chinese Acad Sci, IIE, SKLOIS, Beijing, Peoples R China
[4] Huawei Noahs Ark Lab, London, England
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
DYNAMIC-RANGE EXPANSION;
D O I
10.1109/ICCV48922.2021.00441
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing single image high dynamic range (HDR) reconstruction methods attempt to expand the range of illuminance. They are not effective in generating plausible textures and colors in the reconstructed results, especially for high-density pixels in ultra-high-definition (UHD) images. To address these problems, we propose a new HDR reconstruction network for UHD images by collaboratively learning color and texture details. First, we propose a dual-path network to extract the content and chromatic features at a reduced resolution of the low dynamic range (LDR) input. These two types of features are used to fit bilateral-space affine models for real-time HDR reconstruction. To extract the main data structure of the LDR input, we propose to use 3D Tucker decomposition and reconstruction to prevent pseudo edges and noise amplification in the learned bilateral grid. As a result, the high-quality content and chromatic features can be reconstructed capitalized on guided bilateral upsampling. Finally, we fuse these two full-resolution feature maps into the HDR reconstructed results. Our proposed method can achieve real-time processing for UHD images (about 160 fps). Experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art HDR reconstruction approaches on public benchmarks and real-world UHD images.
引用
收藏
页码:4429 / 4438
页数:10
相关论文
共 50 条
  • [1] Ultra-High-Definition Image Dehazing via Multi-Guided Bilateral Learning
    Zheng, Zhuoran
    Ren, Wenqi
    Cao, Xiaochun
    Hu, Xiaobin
    Wang, Tao
    Song, Fenglong
    Jia, Xiuyi
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16180 - 16189
  • [2] Learning Non-Uniform-Sampling for Ultra-High-Definition Image Enhancement
    Yu, Wei
    Zhu, Qi
    Zheng, Naishan
    Huang, Jie
    Zhou, Man
    Zhao, Feng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1412 - 1421
  • [3] Benchmarking Ultra-High-Definition Image Super-resolution
    Zhang, Kaihao
    Li, Dongxu
    Luo, Wenhan
    Ren, Wenqi
    Stenger, Bjorn
    Liu, Wei
    Li, Hongdong
    Yang, Ming-Hsuan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14749 - 14758
  • [4] Ultra-high-definition underwater image enhancement via dual-domain interactive transformer network
    Li, Weiwei
    Cao, Feiyuan
    Wei, Yiwen
    Shi, Zhenghao
    Jia, Xiuyi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025, 16 (03) : 2093 - 2109
  • [5] Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing
    Yu, Xin
    Dai, Peng
    Li, Wenbo
    Ma, Lan
    Shen, Jiajun
    Li, Jia
    Qi, Xiaojuan
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 646 - 662
  • [6] Ultra-High-Definition Mapping of Atrial Arrhythmias
    Bun, Sok-Sithikun
    Latcu, Decebal Gabriel
    Delassi, Tahar
    El Jamili, Mohammed
    Al Amoura, Alaa
    Saoudi, Nadir
    CIRCULATION JOURNAL, 2016, 80 (03) : 579 - 586
  • [7] Visual Preference Assessment on Ultra-High-Definition Images
    Kim, Haksub
    Ahn, Sewoong
    Kim, Woojae
    Lee, Sanghoon
    IEEE TRANSACTIONS ON BROADCASTING, 2016, 62 (04) : 757 - 769
  • [8] Ultra-High-Definition Television and Its Optical Transmission
    Oyamada, Kimiyuki
    Nakatogawa, Tsuyoshi
    Nakamura, Madoka
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2011, E94B (04) : 876 - 883
  • [9] UHDNeRF: Ultra-High-Definition Neural Radiance Fields
    Li, Quewei
    Li, Feichao
    Guo, Jie
    Guo, Yanwen
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 23040 - 23051
  • [10] Epicardial bridge via the coronary sinus musculatures revealed by ultra-high-definition mapping
    Yang, Ying Chi
    Aung, Thein Tun
    Doshi, Hardik
    Bailin, Steven J.
    JOURNAL OF ELECTROCARDIOLOGY, 2020, 61 : 106 - 111