No-reference stereoscopic image quality assessment based on global and local content characteristics

被引:26
|
作者
Shen, Lili [1 ]
Chen, Xiongfei [1 ]
Pan, Zhaoqing [1 ,2 ]
Fan, Kefeng [3 ]
Li, Fei [4 ]
Lei, Jianjun [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Weijin Rd, Tianjin 300072, Peoples R China
[2] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[3] China Elect Standardizat Inst, Beijing 100007, Peoples R China
[4] Guangzhou SequoiaDB Co, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Stereoscopic images quality assessment; Cross-fusion; Multi-scales pooling; Asymmetric convolution block; Weighted average; CONVOLUTIONAL NEURAL-NETWORK; STATISTICS;
D O I
10.1016/j.neucom.2020.10.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
No-reference stereoscopic images quality assessment (NR-SIQA) via deep learning has gained increasing attention. In this paper, we propose a no-reference stereoscopic image quality assessment method based on global and local content characteristics. The proposed method simulates the perception route of human visual system, and derives features from the fused view and single view through the global feature fusion sub-network and local feature enhancement sub-network. As for the fused view, a cross fusion strategy is applied to model the process in the V1 visual cortex, and the multi-scales pooling (MSP) is utilized to integrate context information under different sub-regions for effective global feature extraction. As for the single view, the asymmetric convolution block (ACB) is introduced to strengthen the local information description. By jointly considering the fused view and single view, the proposed network can efficiently extract the features for quality assessment. Finally, a weighted average strategy is applied to estimate the visual quality of stereoscopic image. Experimental results on 3D quality databases demonstrate that the proposed network is superior to the state-of-the-art metrics, and achieves an excellent performance. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:132 / 142
页数:11
相关论文
共 50 条
  • [21] NO-REFERENCE QUALITY ASSESSMENT OF STEREOSCOPIC IMAGES BASED ON BINOCULAR COMBINATION OF LOCAL FEATURES STATISTICS
    Fan, Yu
    Larabi, Mohamed-Chaker
    Cheikh, Faouzi Alaya
    Fernandez-Maloigne, Christine
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3538 - 3542
  • [22] No-Reference Stereoscopic Image Quality Assessment Based on Binocular Statistical Features and Machine Learning
    Xu, Peng
    Guo, Man
    Chen, Lei
    Hu, Weifeng
    Chen, Qingshan
    Li, Yujun
    [J]. COMPLEXITY, 2021, 2021
  • [23] A no-Reference Stereoscopic Image Quality Assessment Network Based on Binocular Interaction and Fusion Mechanisms
    Si, Jianwei
    Huang, Baoxiang
    Yang, Huan
    Lin, Weisi
    Pan, Zhenkuan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3066 - 3080
  • [24] No-reference image quality assessment of authentically distorted images with global and local statistics
    Rajchel, Milosz
    Oszust, Mariusz
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2021, 15 (01) : 83 - 91
  • [25] No-Reference Stereoscopic Image Quality Assessment Based on Multi-Level Representation Network
    Shen, Lili
    Wang, Dan
    Xu, Ke
    [J]. Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2021, 54 (04): : 356 - 361
  • [26] No-Reference Stereoscopic Image Quality Assessment Based on The Visual Pathway of Human Visual System
    Meng, Fan
    Li, Sumei
    [J]. 2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [27] No-reference Stereoscopic Image Quality Assessment Based on Parallel Multi-scale Perception
    Zhang, Ziyi
    Li, Sumei
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2022,
  • [28] No-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics
    Li, Yanqing
    Hu, Xinping
    [J]. 2017 2ND INTERNATIONAL CONFERENCE ON MULTIMEDIA AND IMAGE PROCESSING (ICMIP), 2017, : 123 - 127
  • [29] No-reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics
    Appina, Balasubramanyam
    Khan, Sameeulla
    Channappayya, Sumohana S.
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 43 : 1 - 14
  • [30] DEEP LEARNING AND CYCLOPEAN VIEW FOR NO-REFERENCE STEREOSCOPIC IMAGE QUALITY ASSESSMENT
    Messai, Oussama
    Hachouf, Fella
    Seghir, Zianou Ahmed
    [J]. 2018 INTERNATIONAL CONFERENCE ON SIGNAL, IMAGE, VISION AND THEIR APPLICATIONS (SIVA), 2018,