Optimizing a Tone Curve for Backward-Compatible High Dynamic Range Image and Video Compression

被引:119
|
作者
Mai, Zicong [1 ]
Mansour, Hassan [1 ]
Mantiuk, Rafal [2 ]
Nasiopoulos, Panos [1 ]
Ward, Rabab [1 ]
Heidrich, Wolfgang [3 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V5Z 1M9, Canada
[2] Bangor Univ, Sch Comp Sci, Bangor LL57 1UT, Gwynedd, Wales
[3] Univ British Columbia, Dept Comp Sci, Vancouver, BC V6T 1Z4, Canada
关键词
Bit-depth scalable; HDR video compression; high dynamic range imaging; tone-mapping;
D O I
10.1109/TIP.2010.2095866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For backward compatible high dynamic range (HDR) video compression, the HDR sequence is reconstructed by inverse tone-mapping a compressed low dynamic range (LDR) version of the original HDR content. In this paper, we show that the appropriate choice of a tone-mapping operator (TMO) can significantly improve the reconstructed HDR quality. We develop a statistical model that approximates the distortion resulting from the combined processes of tone-mapping and compression. Using this model, we formulate a numerical optimization problem to find the tone-curve that minimizes the expected mean square error (MSE) in the reconstructed HDR sequence. We also develop a simplified model that reduces the computational complexity of the optimization problem to a closed-form solution. Performance evaluations show that the proposed methods provide superior performance in terms of HDR MSE and SSIM compared to existing tone-mapping schemes. It is also shown that the LDR image quality resulting from the proposed methods matches that produced by perceptually-based TMOs.
引用
收藏
页码:1558 / 1571
页数:14
相关论文
共 50 条
  • [31] High dynamic range image and video compression - Fidelity matching human visual performance
    Mantiuk, Rafat
    Krawczyk, Grzegorz
    Myszkowski, Karol
    Seidel, Hans-Peter
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 9 - 12
  • [32] Flicker Reduction in Tone Mapped High Dynamic Range Video
    Guthier, Benjamin
    Kopf, Stephan
    Eble, Marc
    Effelsberg, Wolfgang
    [J]. COLOR IMAGING XVI: DISPLAYING, PROCESSING, HARDCOPY, AND APPLICATIONS, 2011, 7866
  • [33] CHROMA SCALING FOR HIGH DYNAMIC RANGE VIDEO COMPRESSION
    Boitard, Ronan
    Pourazad, Mahsa T.
    Nasiopoulos, Panos
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1387 - 1391
  • [34] Lossy compression of high dynamic range images and video
    Mantiuk, Rafal
    Myszkowski, Karol
    Seidel, Hans-Peter
    [J]. HUMAN VISION AND ELECTRONIC IMAGING XI, 2006, 6057
  • [35] A comparative survey on high dynamic range video compression
    Koz, Alper
    Dufaux, Frederic
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXV, 2012, 8499
  • [36] Image Compression Suitable for High Dynamic Range Image Rendering
    Kaida, Hironori
    Okuda, Masahiro
    [J]. 2008 22ND INTERNATIONAL WORKSHOPS ON ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOLS 1-3, 2008, : 1029 - 1033
  • [37] Study of Hybrid Video Encoding Schemes for Backward-compatible Terrestrial 3DTV Broadcasting Service
    Jeong, Seyoon
    Choi, Jinsoo
    Kim, Jinwoong
    [J]. THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2011, 2011, 8043
  • [38] Unpaired Learning for High Dynamic Range Image Tone Mapping
    Vinker, Yael
    Huberman-Spiegelglas, Inbar
    Fattal, Raanan
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14637 - 14646
  • [39] An Integrated Tone Mapping for High Dynamic Range Image Visualization
    Liang, Lei
    Pan, Jeng-Shyang
    Zhuang, Yongjun
    [J]. 2017 2ND INTERNATIONAL CONFERENCE ON COMMUNICATION, IMAGE AND SIGNAL PROCESSING (CCISP 2017), 2018, 960
  • [40] Hierarchical tone mapping for high dynamic range image visualization
    Qiu, GP
    Duan, J
    [J]. VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2005, PTS 1-4, 2005, 5960 : 2058 - 2066