Adversarial Complementary Learning for Just Noticeable Difference Estimation

被引:0
|
作者
Yu, Dong [1 ]
Jin, Jian [2 ]
Meng, Lili [1 ]
Chen, Zhipeng [3 ]
Zhang, Huaxiang [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[3] Tangshan Normal Univ, Dept Comp Sci, Tangshan 063000, Peoples R China
关键词
Just Noticeable Difference (JND); convolutional neural networks; Human Visual System (HVS); IMAGE QUALITY ASSESSMENT; DISTORTION MODEL; JND MODEL; SIMILARITY; PROFILE;
D O I
10.3837/tiis.2024.02.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, many unsupervised learning -based models have emerged for Just Noticeable Difference (JND) estimation, demonstrating remarkable improvements in accuracy. However, these models suffer from a significant drawback is that their heavy reliance on handcrafted priors for guidance. This restricts the information for estimating JND simply extracted from regions that are highly related to handcrafted priors, while information from the rest of the regions is disregarded, thus limiting the accuracy of JND estimation. To address such issue, on the one hand, we extract the information for estimating JND in an Adversarial Complementary Learning (ACoL) way and propose an ACoL-JND network to estimate the JND by comprehensively considering the handcrafted priors -related regions and non -related regions. On the other hand, to make the handcrafted priors richer, we take two additional priors that are highly related to JND modeling into account, i.e., Patterned Masking (PM) and Contrast Masking (CM). Experimental results demonstrate that our proposed model outperforms the existing JND models and achieves state-of-the-art performance in both subjective viewing tests and objective metrics assessments.
引用
收藏
页码:438 / 455
页数:18
相关论文
共 50 条
  • [1] Transfer learning for just noticeable difference estimation
    Mao, Yongwei
    Wu, Jinjian
    Wang, Xing
    Li, Leida
    Dong, Weisheng
    [J]. INFORMATION SCIENCES, 2023, 648
  • [2] UNSUPERVISED DEEP LEARNING FOR JUST NOTICEABLE DIFFERENCE ESTIMATION
    Wu, Yuhao
    Ji, Weiping
    Wu, Jinjian
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [3] Rethinking and Conceptualizing Just Noticeable Difference Estimation by Residual Learning
    Jiang Q.
    Liu F.
    Wang Z.
    Wang S.
    Lin W.
    [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2024, 34 (10) : 1 - 1
  • [4] Just Noticeable Difference for Machines to Generate Adversarial Images
    Akan, Adil Kaan
    Genc, Mehmet Ali
    Vural, Fatos T. Yarman
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2171 - 2175
  • [5] Survey of visual just noticeable difference estimation
    Jinjian Wu
    Guangming Shi
    Weisi Lin
    [J]. Frontiers of Computer Science, 2019, 13 : 4 - 15
  • [6] Survey of visual just noticeable difference estimation
    Wu, Jinjian
    Shi, Guangming
    Lin, Weisi
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (01) : 4 - 15
  • [7] Structural uncertainty based just noticeable difference estimation
    Wu, Jinjian
    Lin, Weisi
    Shi, Guangming
    [J]. 2014 19TH INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2014, : 768 - 771
  • [8] Just-noticeable difference estimation with pixels in images
    Zhang, Xiaohui
    Lin, Weisi
    Xue, Ping
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2008, 19 (01) : 30 - 41
  • [9] Ant Improvement of Just Noticeable Color Difference Estimation
    Liu, Kuo-Cheng
    [J]. PROCEEDINGS OF THE 2016 FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS (FEDCSIS), 2016, 8 : 803 - 806
  • [10] Just Noticeable Difference Estimation for Screen Content Images
    Wang, Shiqi
    Ma, Lin
    Fang, Yuming
    Lin, Weisi
    Ma, Siwei
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (08) : 3838 - 3851