Reviving Standard-Dynamic-Range Videos for High-Dynamic-Range Devices: A Learning Paradigm With Hybrid Attention Mechanisms

被引:0
|
作者
Chen, Peilin [1 ]
Yang, Wenhan [2 ]
Wang, Shiqi [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518000, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Correlation; Calibration; Videos; TV; High dynamic range; VISIBILITY;
D O I
10.1109/MMUL.2023.3270035
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the prevalence of high-dynamic-range (HDR) display devices, the demand to convert existing standard-dynamic-range television (SDRTV) video content to its corresponding HDR television (HDRTV) counterpart is growing exponentially. Herein, we propose a two-stage learning paradigm with hybrid attention mechanisms to fully exploit spatial, channelwise, and regional correlations for faithfully driving such conversion. Specifically, in the first domain-mapping stage, the depthwise self-attention and global calibration layer are proposed, which adaptively leverage feature intrarelationships to construct better scene representation and achieve engaging SDRTV-to-HDRTV transformation. In the second highlight-generation stage, considering that the overexposed regions potentially lead to detail loss, which brings enormous challenges to the conversion, we propose a regional self-attention module to specifically restore missing highlights. Extensive experimental results on public databases show that our method outperforms state-of-the-art approaches in terms of different quality evaluation measures.
引用
收藏
页码:110 / 118
页数:9
相关论文
共 50 条
  • [31] Robust high-dynamic-range optical roll sensing
    Gillmer, Steven R.
    Yu, Xiangzhi
    Wang, Chen
    Ellis, Jonathan D.
    OPTICS LETTERS, 2015, 40 (11) : 2497 - 2500
  • [32] Hyperspectral high-dynamic-range endoscopic mucosal imaging
    Department of Biomedical Engineering, College of Engineering, Peking University, Beijing
    100871, China
    Chin. Opt. Lett., 7
  • [33] A Novel Approach to Steganography in High-Dynamic-Range Images
    Cheng, Yu-Ming
    Wang, Chung-Ming
    IEEE MULTIMEDIA, 2009, 16 (03) : 70 - 80
  • [34] Learning to Reconstruct High Speed and High Dynamic Range Videos from Events
    Zou, Yunhao
    Zheng, Yinqiang
    Takatani, Tsuyoshi
    Fu, Ying
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 2024 - 2033
  • [35] Scrambling High Dynamic Range Videos Scrambling HDR Videos
    Touil, Med Amine
    Ellouze, Noureddine
    PROCEEDINGS OF 2016 FUTURE TECHNOLOGIES CONFERENCE (FTC), 2016, : 923 - 925
  • [36] Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality
    Mikhailiuk, Aliaksei
    Perez-Ortiz, Maria
    Yue, Dingcheng
    Suen, Wilson
    Mantiuk, Rafal K.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2125 - 2138
  • [37] HIGH-DYNAMIC-RANGE AM DETECTOR FOR DATA LOGGING APPLICATIONS
    HERON, ML
    ROSE, RJ
    ELECTRONICS LETTERS, 1983, 19 (24) : 1051 - 1052
  • [38] High-dynamic-range mixer upconverts 1.5 to 3.8 GHz
    Browne, Jack
    MICROWAVES & RF, 2008, 47 (05) : 146 - 146
  • [39] A New Hybrid Tone Mapping Scheme for High Dynamic Range (HDR) Videos
    Shahid, H.
    Li, D.
    Fanaswala, A.
    Pourazad, M. T.
    Nasiopoulos, P.
    2015 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2015, : 351 - 352
  • [40] High-dynamic-range laser range finders based on a novel multimodulated frequency method
    Mang Ou-Yang
    Huang, Chen-Yi
    Chen, Junewen
    OPTICAL ENGINEERING, 2006, 45 (12)