Multi-Frame Content-Aware Mapping Network for Standard-Dynamic-Range to High-Dynamic-Range Television Artifact Removal

被引:0
|
作者
Wang, Zheng [1 ]
He, Gang [1 ]
机构
[1] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
关键词
standard dynamic range (SDR); high dynamic range (HDR); video coding; artifact removal; RECONSTRUCTION;
D O I
10.3390/s24010299
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Recently, advancements in image sensor technology have paved the way for the proliferation of high-dynamic-range television (HDRTV). Consequently, there has been a surge in demand for the conversion of standard-dynamic-range television (SDRTV) to HDRTV, especially due to the dearth of native HDRTV content. However, since SDRTV often comes with video encoding artifacts, SDRTV to HDRTV conversion often amplifies these encoding artifacts, thereby reducing the visual quality of the output video. To solve this problem, this paper proposes a multi-frame content-aware mapping network (MCMN), aiming to improve the performance of conversion from low-quality SDRTV to high-quality HDRTV. Specifically, we utilize the temporal spatial characteristics of videos to design a content-aware temporal spatial alignment module for the initial alignment of video features. In the feature prior extraction stage, we innovatively propose a hybrid prior extraction module, including cross-temporal priors, local spatial priors, and global spatial prior extraction. Finally, we design a temporal spatial transformation module to generate an improved tone mapping result. From time to space, from local to global, our method makes full use of multi-frame information to perform inverse tone mapping of single-frame images, while it is also able to better repair coding artifacts.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Evaluating tone mapping algorithms for rendering non-pictorial (scientific) high-dynamic-range images
    Park, Sung Ho
    Montag, Ethan D.
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2007, 18 (05) : 415 - 428
  • [22] Validation of digital photography, in low-range (standard) and high-dynamic-range (HDR) for calculating the melasma area and severity index (MASI)
    Valdes-Gonzalez, G.
    Esquivel-Pinto Israel, I.
    Torres-Alvarez, B.
    Castanedo-Cazares, J. P.
    AUSTRALASIAN JOURNAL OF DERMATOLOGY, 2014, 55 (04) : A2 - A3
  • [23] High-dynamic-range image rendering using hybrid tone mapping and automatic k factor decision
    Jung, Cheolkon
    Fang, Ying
    Jiao, Licheng
    JOURNAL OF ELECTRONIC IMAGING, 2013, 22 (03)
  • [24] Intensity Mapping Function Based Weighted Frame Averaging for High Dynamic Range Imaging
    Yao, W.
    Li, Z. G.
    Rahardja, S.
    2011 6TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2011, : 1574 - 1577
  • [25] High-Dynamic-Range Parallel Multi-Scale Retinex Enhancement with Spatially-Adaptive Prior
    Pei, Soo-Chang
    Shen, Chih-Tsung
    2014 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2014, : 2720 - 2723
  • [26] Noise Removal and Real-Time Detail Enhancement of High-Dynamic-Range Infrared Images with Time Consistency
    Garcia, Frederic
    Schockaert, Cedric
    Mirbach, Bruno
    TWELFTH INTERNATIONAL CONFERENCE ON QUALITY CONTROL BY ARTIFICIAL VISION, 2015, 9534
  • [27] Tone mapping-based high-dynamic-range image compression: study of optimization criterion and perceptual quality
    Narwaria, Manish
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    Pepion, Romuald
    OPTICAL ENGINEERING, 2013, 52 (10)
  • [28] Evaluation of HDR tone-mapping algorithms using a high-dynamic-range display to emulate real scenes
    Kuang, Jiangtao
    Heckaman, Rodney
    Fairchild, Mark D.
    JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2010, 18 (07) : 461 - 468
  • [29] Structure-embedded ghosting artifact suppression network for high dynamic range image reconstruction
    Tang, Lingfeng
    Huang, Huan
    Zhang, Yafei
    Qi, Guanqiu
    Yu, Zhengtao
    KNOWLEDGE-BASED SYSTEMS, 2023, 263
  • [30] Missing Content Restoration and Ghosting Suppression Network for High Dynamic Range Imaging
    Yang Z.
    Li H.
    Zhang Y.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2024, 37 (04): : 313 - 327