A MULTI-METRIC FUSION APPROACH TO VISUAL QUALITY ASSESSMENT

被引:0
|
作者
Liu, Tsung-Jung [1 ,2 ]
Lin, Weisi [3 ]
Kuo, C-C Jay [1 ,2 ]
机构
[1] Univ So Calif, Ming Hsieh Dept Elect Engn, Los Angeles, CA 90089 USA
[2] Univ So Calif, Signal & Image Proc Inst, Los Angeles, CA 90089 USA
[3] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
关键词
Visual quality assessment; machine learning; multi-metric fusion (MMF); context-dependent MMF (CD-MMF); context-free MMF (CF-MMF); INFORMATION;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper presents a new methodology for objective visual quality assessment with multi-metric fusion (MMF). The current research is motivated by the observation that there is no single metric that gives the best performance scores in all situations. To achieve MMF, we adopt a regression approach. First, we collect a large number of image samples, each of which has a score labeled by human observers and scores associated with different metrics. The new MMF score is set to be the nonlinear combination of multiple metrics with suitable weights obtained by a training process. Furthermore, we divide image distortions into groups and perform regression within each group, which is called "context-dependent MMF" (CD-MMF). One task in CD-MMF is to determine the context automatically, which is achieved by a machine learning approach. It is shown by experimental results that the proposed MMF metric outperforms all existing metrics by a significant margin.
引用
收藏
页码:72 / 77
页数:6
相关论文
共 50 条
  • [1] Multi-Metric Fusion Network for Image Quality Assessment
    Peng, Yanding
    Xu, Jiahua
    Luo, Ziyuan
    Zhou, Wei
    Chen, Zhibo
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 1857 - 1860
  • [2] Image Quality Assessment with Transformers and Multi-Metric Fusion Modules
    Jiang, Wei
    Li, Litian
    Ma, Yi
    Zhai, Yongqi
    Yang, Zheng
    Wang, Ronggang
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1804 - 1808
  • [3] A multi-metric approach for block-level video quality assessment
    Papadopoulos, Miltiadis Alexios
    Katsenou, Angeliki, V
    Agrafiotis, Dimitris
    Bull, David R.
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 : 152 - 158
  • [4] A VIEWPORT-DRIVEN MULTI-METRIC FUSION APPROACH FOR 360-DEGREE VIDEO QUALITY ASSESSMENT
    Azevedo, Roberto G. de A.
    Birkbeck, Neil
    Janatra, Ivan
    Adsumilli, Balu
    Frossard, Pascal
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [5] PERCEPTUAL IMAGE QUALITY ASSESSMENT USING BLOCK-BASED MULTI-METRIC FUSION (BMMF)
    Jin, Lina
    Egiazarian, Karen
    Kuo, C-C Jay
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 1145 - 1148
  • [6] A multi-metric approach for research evaluation
    Rousseau, Ronald
    Ye, Fred Y.
    [J]. CHINESE SCIENCE BULLETIN, 2013, 58 (26): : 3288 - 3290
  • [7] Multi-metric learning for multi-sensor fusion based classification
    Zhang, Yanning
    Zhang, Haichao
    Nasrabadi, Nasser M.
    Huang, Thomas S.
    [J]. INFORMATION FUSION, 2013, 14 (04) : 431 - 440
  • [8] Multi-Metric Evaluation of Thermal-to-Visual Face Recognition
    Lai, Kenneth
    Yanushkevich, Svetlana N.
    [J]. 2019 EIGHTH INTERNATIONAL CONFERENCE ON EMERGING SECURITY TECHNOLOGIES (EST), 2019,
  • [9] Adaptive Multi-Metric Fusion for Person Re-identification
    Li, Penglin
    Liu, Mengxue
    Gu, Yun
    Yao, Lixiu
    Yang, Jie
    [J]. PATTERN RECOGNITION (CCPR 2016), PT I, 2016, 662 : 258 - 267
  • [10] A Multi-Metric Ranking Approach for Library Migration Recommendations
    He, Hao
    Xu, Yulin
    Ma, Yixiao
    Xu, Yifei
    Liang, Guangtai
    Zhou, Minghui
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER 2021), 2021, : 72 - 83