No Reference Quality Assessment for Screen Content Images Using Stacked Autoencoders in Pictorial and Textual Regions

被引:50
|
作者
Yang, Jiachen [1 ]
Zhao, Yang [1 ]
Liu, Jiacheng [1 ]
Jiang, Bin [1 ]
Meng, Qinggang [2 ]
Lu, Wen [3 ]
Gao, Xinbo [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Loughborough Univ, Dept Comp Sci, Loughborough LE11 3TU, Leics, England
[3] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[4] Xidian Univ, Sch Elect Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Measurement; Feature extraction; Visualization; Databases; Distortion; Image quality; Optical character recognition software; Human visual system (HVS); quality-aware features; screen content image (SCI); stacked autoencoders (SAE); unsupervised approach; INFORMATION; SIMILARITY; STATISTICS;
D O I
10.1109/TCYB.2020.3024627
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, the visual quality evaluation of screen content images (SCIs) has become an important and timely emerging research theme. This article presents an effective and novel blind quality evaluation metric for SCIs by using stacked autoencoders (SAE) based on pictorial and textual regions. Since the SCI consists of not only the pictorial area but also the textual area, the human visual system (HVS) is not equally sensitive to their different distortion types. First, the textual and pictorial regions can be obtained by dividing an input SCI via an SCI segmentation metric. Next, we extract quality-aware features from the textual region and pictorial region, respectively. Then, two different SAEs are trained via an unsupervised approach for quality-aware features that are extracted from these two regions. After the training procedure of the SAEs, the quality-aware features can evolve into more discriminative and meaningful features. Subsequently, the evolved features and their corresponding subjective scores are input into two regressors for training. Each regressor can obtain one output predictive score. Finally, the final perceptual quality score of a test SCI is computed by these two predicted scores via a weighted model. Experimental results on two public SCI-oriented databases have revealed that the proposed scheme can compare favorably with the existing blind image quality assessment metrics.
引用
收藏
页码:2798 / 2810
页数:13
相关论文
共 50 条
  • [1] NO REFERENCE QUALITY ASSESSMENT FOR SCREEN CONTENT IMAGES
    Fang, Yuming
    Yan, Jiebin
    Li, Leida
    Wu, Jinjian
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2017,
  • [2] Reduced-Reference Quality Assessment of Screen Content Images
    Wang, Shiqi
    Gu, Ke
    Zhang, Xinfeng
    Lin, Weisi
    Ma, Siwei
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (01) : 1 - 14
  • [3] No-Reference Image Quality Assessment Using Shearlet Transform and Stacked Autoencoders
    Li, Yuming
    Po, Lai-Man
    Xu, Xuyuan
    Feng, Litong
    Yuan, Fang
    Cheung, Chun-Ho
    Cheung, Kwok-Wai
    [J]. 2015 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2015, : 1594 - 1597
  • [4] Unifying Pictorial and Textual Features for Screen Content Image Quality Evaluation
    Chen, Yihua
    Liang, Xiaoping
    Yu, Mengzhu
    Tang, Zhenjun
    [J]. PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1099 - 1103
  • [5] Perceptual Quality Assessment of Screen Content Images
    Yang, Huan
    Fang, Yuming
    Lin, Weisi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) : 4408 - 4421
  • [6] Quality Assessment for Natural and Screen Content Images
    Loh, Woei-Tan
    Joseph, Annie Anak
    Bong, David B. L.
    [J]. PROCEEDINGS OF THE 2019 IEEE INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING APPLICATIONS (IEEE ICSIPA 2019), 2019, : 204 - 207
  • [7] No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation
    Fang, Yuming
    Yan, Jiebin
    Li, Leida
    Wu, Jinjian
    Lin, Weisi
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1600 - 1610
  • [8] No-Reference Quality Assessment for Screen Content Images Using Visual Edge Model and AdaBoosting Neural Network
    Yang, Jiachen
    Bian, Zilin
    Liu, Jiacheng
    Jiang, Bin
    Lu, Wen
    Gao, Xinbo
    Song, Houbing
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6801 - 6814
  • [9] No-reference screen content video quality assessment
    Li, Teng
    Min, Xiongkuo
    Zhu, Wenhan
    Xu, Yiling
    Zhang, Wenjun
    [J]. DISPLAYS, 2021, 69
  • [10] No-Reference Quality Assessment of Screen Content Pictures
    Gu, Ke
    Zhou, Jun
    Qiao, Jun-Fei
    Zhai, Guangtao
    Lin, Weisi
    Bovik, Alan Conrad
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (08) : 4005 - 4018