FPANet: Frequency-based video demoiréing using frame-level post alignment

被引:0
|
作者
Oh, Gyeongrok [1 ]
Kim, Sungjune [1 ]
Gu, Heon [4 ]
Yoon, Sang Ho [3 ]
Kim, Jinkyu [2 ]
Kim, Sangpil [1 ]
机构
[1] Department of Artificial Intelligence, Korea University, Korea, Republic of
[2] Department of Computer Science and Engineering, Korea University, Korea, Republic of
[3] of Culture Technology, KAIST, Korea, Republic of
[4] LG Display Research Center, Korea, Republic of
关键词
Image quality - Image reconstruction - Large datasets - Video analysis;
D O I
10.1016/j.neunet.2024.107021
中图分类号
学科分类号
摘要
Moiré patterns, created by the interference between overlapping grid patterns in the pixel space, degrade the visual quality of images and videos. Therefore, removing such patterns (demoiréing) is crucial, yet remains a challenge due to their complexities in sizes and distortions. Conventional methods mainly tackle this task by only exploiting the spatial domain of the input images, limiting their capabilities in removing large-scale moiré patterns. Therefore, this work proposes FPANet, an image–video demoiréing network that learns filters in both frequency and spatial domains, improving the restoration quality by removing various sizes of moiré patterns. To further enhance, our model takes multiple consecutive frames, learning to extract frame-invariant content features and outputting better quality temporally consistent images. We demonstrate the effectiveness of our proposed method with a publicly available large-scale dataset, observing that ours outperforms the state-of-the-art approaches in terms of image and video quality metrics and visual experience. © 2024
引用
收藏
相关论文
共 31 条
  • [1] Dual frame-level and region-level alignment for unsupervised video domain adaptation
    Hu, Xinyue
    Zhu, Yingying
    [J]. NEUROCOMPUTING, 2023, 550
  • [2] Video expression recognition based on frame-level attention mechanism
    陈瑞
    TONG Ying
    ZHANG Yiye
    XU Bo
    [J]. High Technology Letters, 2023, 29 (02) : 130 - 139
  • [3] Video expression recognition based on frame-level attention mechanism
    Chen R.
    Tong Y.
    Zhang Y.
    Xu B.
    [J]. High Technology Letters, 2023, 29 (02) : 130 - 139
  • [4] DemMamba: Alignment-free Raw Video Demoiréing with Frequency-assisted Spatio-Temporal Mamba
    Xu, Shuning
    Liu, Xina
    Song, Binbin
    Chen, Xiangyu
    Chen, Qiubo
    Zhou, Jiantao
    [J]. arXiv,
  • [5] SNR-based frame-level video bit rate allocation
    Zhuang, Xinhua
    Liu, Li
    Lan, Junqiang
    [J]. 2006 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-11, PROCEEDINGS, 2006, : 2869 - +
  • [6] Prediction-based Loss Recovery for Frame-level Streaming Video
    Kuo, Chun-, I
    Shih, Chi-Huang
    Shieh, Ce-Kuen
    Hwang, Wen-Shyang
    [J]. 2011 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2011, : 72 - 76
  • [7] Two Stage Emotion Recognition using Frame-level and Video-level Features
    Viegas, Carla
    [J]. 2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 912 - 915
  • [8] Frame-level Bit Allocation Optimization Based on Video Content Characteristics for HEVC
    Pan, Zhaoqing
    Yi, Xiaokai
    Zhang, Yun
    Yuan, Hui
    Wang, Fu Lee
    Kwong, Sam
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
  • [9] CNN-Based Prediction of Frame-Level Shot Importance for Video Summarization
    Al Nahian, Mohaiminul
    Iftekhar, A. S. M.
    Islam, Mohammad Tariqul
    Rahman, S. M. Mahbubur
    Hatzinakos, Dimitrios
    [J]. 2017 INTERNATIONAL CONFERENCE ON NEW TRENDS IN COMPUTING SCIENCES (ICTCS), 2017, : 24 - 29
  • [10] Video-based Frame-level Facial Analysis of Affective Behavior on Mobile Devices using EfficientNets
    Savchenko, Andrey, V
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2358 - 2365