Towards adversarial robustness verification of no-reference imageand video-quality metrics

被引:1
|
作者
Shumitskaya, Ekaterina [1 ]
Antsiferova, Anastasia [2 ,3 ]
Vatolin, Dmitriy [1 ,2 ,3 ]
机构
[1] Lomonosov Moscow State Univ, Graphics & Media Lab, Moscow 119992, Russia
[2] RAS, ISP RAS Res Ctr Trusted Artificial Intelligence, Ivannikov Inst Syst Programming, Moscow 109004, Russia
[3] Lomonosov Moscow State Univ, Inst Artificial Intelligence, Moscow 119192, Russia
关键词
Image Quality Assessment; Blind Image Quality Assessment; Attacks on Image-Quality Metrics;
D O I
10.1016/j.cviu.2023.103913
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new method of analysing the stability of modern deep imageand video -quality metrics to different adversarial attacks. The stability analysis of quality metrics is becoming important because nowadays the majority of metrics employ neural networks. Unlike traditional quality metrics based on nature scene statistics or other hand -crafter features, learning -based methods are more vulnerable to adversarial attacks. The usage of such unstable metrics in benchmarks may lead to being exploited by the developers of image and video processing algorithms to achieve higher positions in leaderboards. The majority of known adversarial attacks on images designed for computer vision tasks are not fast enough to be used within realtime video processing algorithms. We propose four fast attacks on metrics suitable for real -life scenarios. The proposed methods are based on creating perturbations that increase metrics scores and can be applied frame -by -frame to attack videos. We analyse the stability of seven widely used no -reference imageand videoquality metrics to proposed attacks. The results showed that only three metrics are stable against our real -life attacks. This research yields insights to further aid in designing stable neural -network -based no -reference quality metrics. Proposed attacks can serve as an additional verification of metrics' reliability.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks
    Antsiferova, Anastasia
    Abud, Khaled
    Gushchin, Aleksandr
    Shumitskaya, Ekaterina
    Lavrushkin, Sergey
    Vatolin, Dmitriy
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 700 - 708
  • [2] A Comparative Study on No-Reference Video Quality Assessment Metrics
    Zerman, Emin
    Akar, Gozde Bozdagi
    Konuk, Baris
    Yilmaz, Gokce Nur
    2014 22ND SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2014, : 1774 - 1777
  • [3] On Verification of Blur and Sharpness Metrics for No-reference Image Visual Quality Assessment
    Bahnemiri, Sheyda Ghanbaralizadeh
    Ponomarenko, Mykola
    Egiazarian, Karen
    2020 IEEE 22ND INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2020,
  • [4] No-reference omnidirectional video quality assessment based on generative adversarial networks
    Jiefeng Guo
    Yao Luo
    Multimedia Tools and Applications, 2021, 80 : 27531 - 27552
  • [5] No-reference omnidirectional video quality assessment based on generative adversarial networks
    Guo, Jiefeng
    Luo, Yao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (18) : 27531 - 27552
  • [6] No-Reference Quality Metrics for Image Decolorization
    Ayunts, Hrach
    Agaian, Sos
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2023, 69 (04) : 1177 - 1185
  • [7] DESIGN OF NO-REFERENCE VIDEO QUALITY METRICS WITH MULTIWAY PARTIAL LEAST SQUARES REGRESSION
    Keimel, Christian
    Habigt, Julian
    Klimpke, Manuel
    Diepold, Klaus
    2011 THIRD INTERNATIONAL WORKSHOP ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2011, : 49 - 54
  • [8] Analysis of No-Reference IQA Metrics and Their Verification for Image Databases
    Ieremeiev, Oleg
    Rubel, Andrii
    2019 IEEE 2ND UKRAINE CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (UKRCON-2019), 2019, : 1152 - 1157
  • [9] Video compression dataset and benchmark of learning-based video-quality metrics
    Antsiferova, Anastasia
    Lavrushkin, Sergey
    Smirnov, Maksim
    Gushchin, Alexander
    Vatolin, Dmitriy
    Kulikov, Dmitriy
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] No-Reference Video Shakiness Quality Assessment
    Cui, Zhaoxiong
    Jiang, Tingting
    COMPUTER VISION - ACCV 2016, PT V, 2017, 10115 : 396 - 411