A Blind Stereoscopic Image Quality Evaluator With Segmented Stacked Autoencoders Considering the Whole Visual Perception Route

被引:43
|
作者
Yang, Jiachen [1 ]
Sim, Kyohoon [1 ]
Gao, Xinbo [2 ]
Lu, Wen [3 ]
Meng, Qinggang [4 ]
Li, Baihua [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Xidian Univ, Sch Elect Engn, State Key Lab Integrated Serv Networks, Xian 710126, Shaanxi, Peoples R China
[3] Xidian Univ, Sch Elect Engn, Xian 710126, Shaanxi, Peoples R China
[4] Loughborough Univ, Dept Comp Sci, Loughborough LE11 3TU, Leics, England
基金
中国国家自然科学基金;
关键词
Stereoscopic image quality assessment; retinal ganglion cell; lateral geniculate nucleus; segmented stacked auto-encoders; edge quality; color quality; NATURAL SCENE STATISTICS;
D O I
10.1109/TIP.2018.2878283
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the current blind stereoscopic image quality assessment (SIQA) algorithms cannot show reliable accuracy. One reason is that they do not have the deep architectures and the other reason is that they are designed on the relatively weak biological basis, compared with the findings on the human visual system. In this paper, we propose a Deep Edge and COlor Signal INtegrity Evaluator (DECOSINE) based on the whole visual perception route from eyes to the frontal lobe, and especially focus on the edge and color signal processing in retinal ganglion cells and lateral geniculate nucleus. Furthermore, to model the complex and deep structure of the visual cortex, segmented stacked auto-encoder (S-SAE) is used, which has not utilized for SIQA before. The utilization of the S-SAE complements the weakness of deep learning-based SIQA metrics that require a very long training time. Experiments are conducted on popular SIQA databases, and the superiority of DECOSINE in terms of prediction accuracy and monotonicity is proved. The experimental results show that our model about the whole visual perception route and utilization of S-SAE are effective for SIQA.
引用
收藏
页码:1314 / 1328
页数:15
相关论文
共 21 条
  • [1] Blind Stereoscopic Image Quality Evaluator Based on Binocular Semantic and Quality Channels
    Sim, Kyohoon
    Yang, Jiachen
    Lu, Wen
    Gao, Xinbo
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1389 - 1398
  • [2] No -reference stereoscopic image quality evaluator with segmented monocular features and perceptual binocular features
    Liu, Yun
    Tang, Chang
    Zheng, Zhi
    Lin, Liyuan
    [J]. NEUROCOMPUTING, 2020, 405 : 126 - 137
  • [3] Viewport Perception Based Blind Stereoscopic Omnidirectional Image Quality Assessment
    Qi, Yubin
    Jiang, Gangyi
    Yu, Mei
    Zhang, Yun
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (10) : 3926 - 3941
  • [4] Blind Quality Assessment of Stereoscopic Images Considering Binocular Perception Based on Shearlet Decomposition
    Wan, Donghui
    Jiang, Xiuhua
    Shen, Qing
    [J]. IEEE ACCESS, 2023, 11 : 96387 - 96400
  • [5] No-reference stereoscopic image quality evaluator based on human visual characteristics and relative gradient orientation
    Liu, Yun
    Huang, Baoqing
    Yu, Hongwei
    Zheng, Zhi
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [6] BQE-CVP: Blind Quality Evaluator for Colored Point Cloud Based on Visual Perception
    Hua, Lei
    Jiang, Gangyi
    Yu, Mei
    He, Zhouyan
    [J]. 2021 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2021,
  • [7] No-Reference Stereoscopic Image Quality Assessment Based on Visual Attention and Perception
    Li, Yafei
    Yang, Feng
    Wan, Wenbo
    Wang, Jun
    Gao, Min
    Zhang, Jia
    Sun, Jiande
    [J]. IEEE ACCESS, 2019, 7 : 46706 - 46716
  • [8] Blind tone mapped image quality assessment with image segmentation and visual perception
    Chi, Biwei
    Yu, Mei
    Jiang, Gangyi
    He, Zhouyan
    Peng, Zongju
    Chen, Fen
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 67
  • [9] VP-NIQE: An opinion-unaware visual perception natural image quality evaluator
    Wu, Leyuan
    Zhang, Xiaogang
    Chen, Hua
    Wang, Dingxiang
    Deng, Jingfang
    [J]. NEUROCOMPUTING, 2021, 463 : 17 - 28
  • [10] Stereoscopic image quality assessment considering visual mechanism and multi-loss constraints
    Li, Sumei
    Li, Yueyang
    Han, Yongtian
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79