Contrastive learning for deep tone mapping operator

被引:0
|
作者
Li, Di [1 ]
Wang, Mou [2 ]
Rahardja, Susanto [1 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Shaanxi, Peoples R China
[2] Chinese Acad Sci, Inst Acoust, Beijing 100190, Peoples R China
[3] Singapore Inst Technol, Singapore 138683, Singapore
关键词
Generative adversarial net; Tone mapping; High dynamic range images; Deep learning; Contrastive learning; DECOMPOSITION MODEL; QUALITY ASSESSMENT; REPRODUCTION;
D O I
10.1016/j.image.2024.117130
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Most existing tone mapping operators (TMOs) are developed based on prior assumptions of human visual system, and they are known to be sensitive to hyperparameters. In this paper, we proposed a straightforward yet efficient framework to automatically learn the priors and perform tone mapping in an end -to -end manner. The proposed algorithm utilizes a contrastive learning framework to enforce the content consistency between high dynamic range (HDR) inputs and low dynamic range (LDR) outputs. Since contrastive learning aims at maximizing the mutual information across different domains, no paired images or labels are required in our algorithm. Equipped with an attention-based U -Net to alleviate the aliasing and halo artifacts, our algorithm can produce sharp and visually appealing images over various complex real -world scenes, indicating that the proposed algorithm can be used as a strong baseline for future HDR image tone mapping task. Extensive experiments as well as subjective evaluations demonstrated that the proposed algorithm outperforms the existing state -of -the -art algorithms qualitatively and quantitatively. The code is available at https://github. com/xslidi/CATMO.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Deep Tone Mapping Operator for High Dynamic Range Images
    Rana, Aakanksha
    Singh, Praveer
    Valenzise, Giuseppe
    Dufaux, Frederic
    Komodakis, Nikos
    Smolic, Aljosa
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1285 - 1298
  • [2] Unsupervised HDR Image and Video Tone Mapping via Contrastive Learning
    Cao, Cong
    Yue, Huanjing
    Liu, Xin
    Yang, Jingyu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 786 - 798
  • [3] LEARNING-BASED TONE MAPPING OPERATOR FOR IMAGE MATCHING
    Rana, Aakanksha
    Valenzise, Giuseppe
    Dufaux, Frederic
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2374 - 2378
  • [4] iTM-Net: Deep Inverse Tone Mapping Using Novel Loss Function Based on Tone Mapping Operator
    Kinoshita, Yuma
    Kiya, Hitoshi
    [J]. 2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [5] iTM-Net: Deep Inverse Tone Mapping Using Novel Loss Function Considering Tone Mapping Operator
    Kinoshita, Yuma
    Kiya, Hitoshi
    [J]. IEEE ACCESS, 2019, 7 : 73555 - 73563
  • [6] Deep Tone-Mapping Operator Using Image Quality Assessment Inspired Semi-Supervised Learning
    Guo, Cheng
    Jiang, Xiuhua
    [J]. IEEE ACCESS, 2021, 9 : 73873 - 73889
  • [7] Learning-Based Tone Mapping Operator for Efficient Image Matching
    Rana, Aakanksha
    Valenzise, Giuseppe
    Dufaux, Frederic
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (01) : 256 - 268
  • [8] Deep binocular tone mapping
    Zhang, Zhuming
    Han, Chu
    He, Shengfeng
    Liu, Xueting
    Zhu, Haichao
    Hu, Xinghong
    Wong, Tien-Tsin
    [J]. VISUAL COMPUTER, 2019, 35 (6-8): : 997 - 1011
  • [9] Deep binocular tone mapping
    Zhuming Zhang
    Chu Han
    Shengfeng He
    Xueting Liu
    Haichao Zhu
    Xinghong Hu
    Tien-Tsin Wong
    [J]. The Visual Computer, 2019, 35 : 997 - 1011
  • [10] Deep Reverse Tone Mapping
    Endo, Yuki
    Kanamori, Yoshihiro
    Mitani, Jun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):