Multi-Frame Content-Aware Mapping Network for Standard-Dynamic-Range to High-Dynamic-Range Television Artifact Removal

被引:0
|
作者
Wang, Zheng [1 ]
He, Gang [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
关键词
standard dynamic range (SDR); high dynamic range (HDR); video coding; artifact removal; RECONSTRUCTION;
D O I
10.3390/s24010299
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Recently, advancements in image sensor technology have paved the way for the proliferation of high-dynamic-range television (HDRTV). Consequently, there has been a surge in demand for the conversion of standard-dynamic-range television (SDRTV) to HDRTV, especially due to the dearth of native HDRTV content. However, since SDRTV often comes with video encoding artifacts, SDRTV to HDRTV conversion often amplifies these encoding artifacts, thereby reducing the visual quality of the output video. To solve this problem, this paper proposes a multi-frame content-aware mapping network (MCMN), aiming to improve the performance of conversion from low-quality SDRTV to high-quality HDRTV. Specifically, we utilize the temporal spatial characteristics of videos to design a content-aware temporal spatial alignment module for the initial alignment of video features. In the feature prior extraction stage, we innovatively propose a hybrid prior extraction module, including cross-temporal priors, local spatial priors, and global spatial prior extraction. Finally, we design a temporal spatial transformation module to generate an improved tone mapping result. From time to space, from local to global, our method makes full use of multi-frame information to perform inverse tone mapping of single-frame images, while it is also able to better repair coding artifacts.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Reviving Standard-Dynamic-Range Videos for High-Dynamic-Range Devices: A Learning Paradigm With Hybrid Attention Mechanisms
    Chen, Peilin
    Yang, Wenhan
    Wang, Shiqi
    IEEE MULTIMEDIA, 2023, 30 (03) : 110 - 118
  • [2] Deep progressive feature aggregation network for multi-frame high dynamic range imaging
    Xiao, Jun
    Ye, Qian
    Liu, Tianshan
    Zhang, Cong
    Lam, Kin-Man
    NEUROCOMPUTING, 2024, 594
  • [3] Improvement of the signal-to-noise ratio in interferometry using multi-frame high-dynamic-range and normalization algorithms
    Restrepo, Rene
    Uribe-Patarroyo, Nestor
    Belenguer, Tomas
    OPTICS COMMUNICATIONS, 2012, 285 (05) : 546 - 552
  • [4] Gamut Mapping in a High-Dynamic-Range Color Space
    Preiss, Jens
    Fairchild, Mark D.
    Ferwerda, James A.
    Urban, Philipp
    COLOR IMAGING XIX: DISPLAYING, PROCESSING, HARDCOPY, AND APPLICATIONS, 2014, 9015
  • [5] High-Dynamic-Range Tone Mapping in Intelligent Automotive Systems
    Shopovska, Ivana
    Stojkovic, Ana
    Aelterman, Jan
    Van Hamme, David
    Philips, Wilfried
    SENSORS, 2023, 23 (12)
  • [6] Adapting iterative retinex computation for high-dynamic-range tone mapping
    Pan, Shengdong
    An, Xiangjing
    He, Hangen
    JOURNAL OF ELECTRONIC IMAGING, 2013, 22 (02)
  • [7] Sensor-realistic Synthetic Data Engine for Multi-frame High Dynamic Range Photography
    Hu, Jinhan
    Choe, Gyeongmin
    Nadir, Zeeshan
    Nabil, Osama
    Lee, Seok-Jun
    Sheikh, Hamid
    Yoo, Youngjun
    Polley, Michael
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2180 - 2189
  • [8] Tone mapping for high-dynamic-range images using localized gamma correction
    Qiao, Motong
    Ng, Michael K.
    JOURNAL OF ELECTRONIC IMAGING, 2015, 24 (01)
  • [9] An efficient multi-frame dynamic search range motion estimation for H.264
    Sun, Qi-Chao
    Wang, Jing
    Chen, Xin-Hao
    Yu, Lu
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2007, PTS 1 AND 2, 2007, 6508
  • [10] High-dynamic-range image acquisition and display by multi-intensity imagery
    Chen, ZK
    Mu, GG
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 1995, 39 (06): : 559 - 564