Ultra-High-Definition Image HDR Reconstruction via Collaborative Bilateral Learning

被引:20
|
作者
Zheng, Zhuoran [1 ,2 ,3 ]
Ren, Wenqi [2 ,3 ]
Cao, Xiaochun [3 ]
Wang, Tao [4 ]
Jia, Xiuyi [1 ,2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Nanjing Univ Sci & Technol, Jiangsu Key Lab Image & Video Understanding Socia, Nanjing, Peoples R China
[3] Chinese Acad Sci, IIE, SKLOIS, Beijing, Peoples R China
[4] Huawei Noahs Ark Lab, London, England
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
DYNAMIC-RANGE EXPANSION;
D O I
10.1109/ICCV48922.2021.00441
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing single image high dynamic range (HDR) reconstruction methods attempt to expand the range of illuminance. They are not effective in generating plausible textures and colors in the reconstructed results, especially for high-density pixels in ultra-high-definition (UHD) images. To address these problems, we propose a new HDR reconstruction network for UHD images by collaboratively learning color and texture details. First, we propose a dual-path network to extract the content and chromatic features at a reduced resolution of the low dynamic range (LDR) input. These two types of features are used to fit bilateral-space affine models for real-time HDR reconstruction. To extract the main data structure of the LDR input, we propose to use 3D Tucker decomposition and reconstruction to prevent pseudo edges and noise amplification in the learned bilateral grid. As a result, the high-quality content and chromatic features can be reconstructed capitalized on guided bilateral upsampling. Finally, we fuse these two full-resolution feature maps into the HDR reconstructed results. Our proposed method can achieve real-time processing for UHD images (about 160 fps). Experimental results demonstrate that the proposed algorithm performs favorably against the state-of-the-art HDR reconstruction approaches on public benchmarks and real-world UHD images.
引用
收藏
页码:4429 / 4438
页数:10
相关论文
共 50 条
  • [31] Compact ultra-high-definition mixed reality holographic projections with optical fiber lasers
    Skirnewskaja, Jana
    Montelongo, Yunuen
    Wilkinson, Timothy D.
    ELECTRO-OPTICAL AND INFRARED SYSTEMS: TECHNOLOGY AND APPLICATIONS XX, 2023, 12737
  • [32] Blind Video Quality Assessment for Ultra-High-Definition Video Based on Super-Resolution and Deep Reinforcement Learning
    Ying, Zefeng
    Pan, Da
    Shi, Ping
    SENSORS, 2023, 23 (03)
  • [33] Interaction between high resolution and high dynamic range in psychological effects of ultra-high-definition television
    Shishikui, Yoshiaki
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2021, 2021, 11766
  • [34] Panicle Ratio Network: streamlining rice panicle measurement by deep learning with ultra-high-definition aerial images in the field
    Guo, Ziyue
    Yang, Chenghai
    Yang, Wangnen
    Chen, Guoxing
    Jiang, Zhao
    Wang, Botao
    Zhang, Jian
    JOURNAL OF EXPERIMENTAL BOTANY, 2022, 73 (19) : 6575 - 6588
  • [35] Double Domain Guided Real-Time Low-Light Image Enhancement for Ultra-High-Definition Transportation Surveillance
    Qu, Jingxiang
    Liu, Ryan Wen
    Gao, Yuan
    Guo, Yu
    Zhu, Fenghua
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 9550 - 9562
  • [36] Sorting microplastics from other materials in water samples by ultra-high-definition imaging
    Peiponen, Kai-Erik
    Kanyathare, Boniphace
    Hrovat, Blaz
    Papamatthaiakis, Nikolaos
    Hattuniemi, Joni
    Asamoah, Benjamin
    Haapala, Antti
    Koistinen, Arto
    Roussey, Matthieu
    JOURNAL OF THE EUROPEAN OPTICAL SOCIETY-RAPID PUBLICATIONS, 2023, 19 (01)
  • [37] A newly developed 8K ultra-high-definition video microscope for microsurgery
    Kobayashi, Eiji
    Yamashita, Hiromasa
    MICROSURGERY, 2020, 40 (02) : 278 - 279
  • [38] Ultra-high-definition mapping in biatrial macro-reentrant tachycardia: a case study
    Tundo, Fabrizio
    Dello Russo, Antonio
    Casella, Michela
    Fassini, Gaetano
    Moltrasio, Massimo
    Tondo, Claudio
    EUROPACE, 2019, 21 : 17 - 18
  • [39] A Multi-scale Single Ultra-High-Definition Image Dehazing Method Based on Multi-resolution Feature Fusion
    Xue, Ping
    Zhang, Yixin
    Bai, Yurao
    Deng, Shixiong
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, : 3410 - 3431
  • [40] Neural Network-Based Ultra-High-Definition Video Live Streaming Optimization Algorithm
    Feng, Yunning
    Hu, Nan
    Yu, Xiaosheng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022