Real-time video denoising on multicores and GPUs with Kalman-based and Bilateral filters fusion

被引:0
|
作者
Sergio G. Pfleger
Patricia D. M. Plentz
Rodrigo C. O. Rocha
Alyson D. Pereira
Márcio Castro
机构
[1] Federal University of Santa Catarina (UFSC),Department of Informatics and Statistics (INE)
[2] Pontifical Catholic University of Minas Gerais (PUC Minas),Computer Science Department
来源
关键词
Spatiotemporal video denoising; Kalman filter; Bilateral filter; Multicore; GPU;
D O I
暂无
中图分类号
学科分类号
摘要
In the context of video processing, image noise caused by acquisition, transfer and image compression can be attenuated by video denoising algorithms. However, their computational cost must be as low as possible to allow them to be applied to real-time applications. In this paper, we propose stmkf, a real-time video denoising algorithm based on Kalman and Bilateral filters. We evaluate the effectiveness of stmkf using several common videos used in the literature and we compare it to other denoising algorithms using both the PSNR and SSIM metrics. Our experimental results show that stmkf is competitive with other filters, especially for videos that feature stationary backgrounds such as in videoconferencing, video lectures and video surveillance. We also evaluate the performance of our parallel implementations of stmkf for CPUs and GPUs. stmkf achieved a performance improvement of up to 2.9×\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.9\times $$\end{document} on a Intel i7 multicore processor with 4 cores compared to the sequential solution. The results obtained with the GPU version of stmkf on a NVIDIA Tesla K40 showed a performance improvement of up to 7.6×\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$7.6\times $$\end{document} compared to the Intel i7 multicore processor.
引用
收藏
页码:1629 / 1642
页数:13
相关论文
共 50 条
  • [1] Real-time video denoising on multicores and GPUs with Kalman-based and Bilateral filters fusion
    Pfleger, Sergio G.
    Plentz, Patricia D. M.
    Rocha, Rodrigo C. O.
    Pereira, Alyson D.
    Castro, Marcio
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2019, 16 (05) : 1629 - 1642
  • [2] Real-time Video Denoising for 2D Ultrasound Streaming Video on GPUs
    Dolwithayakul, B.
    Chantrapornchai, C.
    Chumchob, N.
    [J]. 2013 INTERNATIONAL COMPUTER SCIENCE AND ENGINEERING CONFERENCE (ICSEC), 2013, : 233 - 238
  • [3] Investigating the application of Kalman Filters for real-time accountancy in fusion fuel cycles
    Flynn, H. B.
    Larsen, George
    [J]. FUSION ENGINEERING AND DESIGN, 2022, 176
  • [4] A VLSI Design of Real-Time Sensor Fusion Unit using Kalman Filters
    Kim, Duckyong
    Ahn, Jun Gil
    Park, Jong Kang
    Kim, Jong Tae
    [J]. 2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 1006 - 1009
  • [5] REAL-TIME IMPLEMENTATION OF SYSTOLIC KALMAN FILTERS
    TRAVASSOS, RH
    [J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1983, 431 : 97 - 104
  • [6] Real-time Controllable Denoising for Image and Video
    Zhang, Zhaoyang
    Jiang, Yitong
    Shao, Wenqi
    Wang, Xiaogang
    Luo, Ping
    Lin, Kaimo
    Gu, Jinwei
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 14028 - 14038
  • [7] REAL-TIME VIDEO DENOISING ON MOBILE PHONES
    Ehmann, Lana
    Chu, Lun-Cheng
    Tsai, Sung-Fang
    Liang, Chia-Kai
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 505 - 509
  • [8] Video Denoising Based on a Spatiotemporal Kalman-Bilateral Mixture Model
    Zuo, Chenglin
    Liu, Yu
    Tan, Xin
    Wang, Wei
    Zhang, Maojun
    [J]. SCIENTIFIC WORLD JOURNAL, 2013,
  • [9] An algorithm for real-time failure detection in Kalman filters
    Zolghadri, A
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1996, 41 (10) : 1537 - 1539
  • [10] A class of Kalman filters for real-time image processing
    Laplante, PA
    Neill, CJ
    [J]. REAL-TIME IMAGING VII, 2003, 5012 : 22 - 29