No-reference stereoscopic image quality assessment based on global and local content characteristics

被引:26
|
作者
Shen, Lili [1 ]
Chen, Xiongfei [1 ]
Pan, Zhaoqing [1 ,2 ]
Fan, Kefeng [3 ]
Li, Fei [4 ]
Lei, Jianjun [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Weijin Rd, Tianjin 300072, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] China Elect Standardizat Inst, Beijing 100007, Peoples R China
[4] Guangzhou SequoiaDB Co, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereoscopic images quality assessment; Cross-fusion; Multi-scales pooling; Asymmetric convolution block; Weighted average; CONVOLUTIONAL NEURAL-NETWORK; STATISTICS;
D O I
10.1016/j.neucom.2020.10.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
No-reference stereoscopic images quality assessment (NR-SIQA) via deep learning has gained increasing attention. In this paper, we propose a no-reference stereoscopic image quality assessment method based on global and local content characteristics. The proposed method simulates the perception route of human visual system, and derives features from the fused view and single view through the global feature fusion sub-network and local feature enhancement sub-network. As for the fused view, a cross fusion strategy is applied to model the process in the V1 visual cortex, and the multi-scales pooling (MSP) is utilized to integrate context information under different sub-regions for effective global feature extraction. As for the single view, the asymmetric convolution block (ACB) is introduced to strengthen the local information description. By jointly considering the fused view and single view, the proposed network can efficiently extract the features for quality assessment. Finally, a weighted average strategy is applied to estimate the visual quality of stereoscopic image. Experimental results on 3D quality databases demonstrate that the proposed network is superior to the state-of-the-art metrics, and achieves an excellent performance. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:132 / 142
页数:11
相关论文
共 50 条
  • [1] NO-REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT BASED ON LOCAL TO GLOBAL FEATURE REGRESSION
    Li, Sumei
    Xue, Jianwei
    Han, Yongtian
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 448 - 453
  • [2] No-reference Image Quality Assessment based on Global and Local Content Perception
    Sun, Cuirong
    Li, Houqiang
    Li, Weiping
    [J]. 2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [3] No-Reference Stereoscopic Image Quality Assessment
    Akhter, Roushain
    Sazzad, Z. M. Parvez
    Horita, Y.
    Baltes, J.
    [J]. STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
  • [4] Local and global sparse representation for no-reference quality assessment of stereoscopic images
    Li, Fucui
    Shao, Feng
    Jiang, Qiuping
    Fu, Randi
    Jiang, Gangyi
    Yu, Mei
    [J]. INFORMATION SCIENCES, 2018, 422 : 110 - 121
  • [5] Two-stream interactive network based on local and global information for No-Reference Stereoscopic Image Quality Assessment
    Liu, Yun
    Huang, Baoqing
    Yue, Guanghui
    Wu, Jingkai
    Wang, Xiaoxu
    Zheng, Zhi
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
  • [6] No-reference Stereoscopic Image Quality Assessment Based on Contourlet Transform
    Li, Chen
    Yu, Shuiyuan
    Hong, Zhiguo
    [J]. PROCEEDINGS OF 2016 IEEE ADVANCED INFORMATION MANAGEMENT, COMMUNICATES, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IMCEC 2016), 2016, : 589 - 594
  • [7] No-reference stereoscopic image quality assessment based on cyclopean image and enhanced image
    Li, Sumei
    Ding, Yixiu
    Chang, Yongli
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2020, 14 (03) : 565 - 573
  • [8] No-reference stereoscopic image quality assessment based on cyclopean image and enhanced image
    Sumei Li
    Yixiu Ding
    Yongli Chang
    [J]. Signal, Image and Video Processing, 2020, 14 : 565 - 573
  • [9] No-reference Stereoscopic Image Quality Assessment Based on Visual Saliency Region
    Wang, Xin
    Sheng, Yuxia
    [J]. 2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 2070 - 2074
  • [10] No-Reference Stereoscopic Image Quality Assessment Based on Binocular Neuron Response
    Ye Mengmeng
    Hu Jinbin
    Wang Xuejin
    Shao Feng
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (24)