CUDAS: Distortion-Aware Saliency Benchmark

被引:1
|
作者
Zhao, Xin [1 ]
Lou, Jianxun [1 ]
Wu, Xinbo [1 ]
Wu, Yingying [1 ]
Leveque, Lucie [2 ]
Liu, Xiaochang [3 ]
Guo, Pengfei [4 ]
Qin, Yipeng [1 ]
Lin, Hanhe [5 ]
Saupe, Dietmar [6 ]
Liu, Hantao [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF24 4AG, Wales
[2] Nantes Univ, UMR CNRS LS2N 6004, F-44000 Nantes, France
[3] Sun Yat Sen Univ, Sch Mat, Guangzhou 510275, Peoples R China
[4] Zhongkai Univ Agr & Engn, Sch Computat Sci, Guangzhou 510225, Peoples R China
[5] Univ Dundee, Sch Sci & Engn, Dundee DD1 4HN, Scotland
[6] Univ Konstanz, Dept Comp & Informat Sci, D-78457 Constance, Germany
关键词
Eye-tracking; saliency; distortion; image quality; deep learning; ENCODER-DECODER NETWORK; VISUAL-ATTENTION; BOTTOM-UP; EYE-TRACKING; MODEL;
D O I
10.1109/ACCESS.2023.3283344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual saliency prediction remains an academic challenge due to the diversity and complexity of natural scenes as well as the scarcity of eye movement data on where people look in images. In many practical applications, digital images are inevitably subject to distortions, such as those caused by acquisition, editing, compression or transmission. A great deal of attention has been paid to predicting the saliency of distortion-free pristine images, but little attention has been given to understanding the impact of visual distortions on saliency prediction. In this paper, we first present the CUDAS database - a new distortion-aware saliency benchmark, where eye-tracking data was collected for 60 pristine images and their corresponding 540 distorted formats. We then conduct a statistical evaluation to reveal the behaviour of state-of-the-art saliency prediction models on distorted images and provide insights on building an effective model for distortion-aware saliency prediction. The new database is made publicly available to the research community.
引用
收藏
页码:58025 / 58036
页数:12
相关论文
共 50 条
  • [41] Distortion-Aware Multicasting of Multiple Description Coded Media in Wireless Mesh Networks
    Alganas, Abdulelah
    Zhao, Dongmei
    IEEE 2018 INTERNATIONAL CONGRESS ON CYBERMATICS / 2018 IEEE CONFERENCES ON INTERNET OF THINGS, GREEN COMPUTING AND COMMUNICATIONS, CYBER, PHYSICAL AND SOCIAL COMPUTING, SMART DATA, BLOCKCHAIN, COMPUTER AND INFORMATION TECHNOLOGY, 2018, : 313 - 319
  • [42] Distortion-Aware Phase Retrieval Receiver for Carrierless High-Order QAM Transmission
    Huang, Hanzi
    Chen, Haoshuo
    Gao, Qi
    Huang, Yetian
    Fontaine, Nicolas K.
    Mazur, Mikael
    Dallachiesa, Lauren
    Ryf, Roland
    Li, Zhengxuan
    Song, Yingxiong
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2024, 42 (13) : 4372 - 4385
  • [43] Cloud Removal in Optical Remote Sensing Imagery Using Multiscale Distortion-Aware Networks
    Yu, Weikang
    Zhang, Xiaokang
    Pun, Man-On
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [44] General-purpose image quality assessment based on distortion-aware decision fusion
    Peng, Peng
    Li, Ze-Nian
    NEUROCOMPUTING, 2014, 134 : 117 - 121
  • [45] A Distortion-Aware Multi-Task Learning Framework for Fractional Interpolation in Video Coding
    Yu, Liangwei
    Shen, Liquan
    Yang, Hao
    Jiang, Xuhao
    Yan, Bo
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (07) : 2824 - 2836
  • [46] DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network
    Pan, Zhaoqing
    Zhang, Hao
    Lei, Jianjun
    Fang, Yuming
    Shao, Xiao
    Ling, Nam
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7518 - 7531
  • [47] Distortion-aware Virtual Environments Transmission Scheme over a Bandwidth-limited Network
    Guo, Jingfeng
    Liu, Yitong
    Sang, Lin
    Yang, Hongwen
    2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
  • [48] Probabilistically Shaped 64-QAM Transmission via Distortion-aware Phase Retrieval
    Huang, Hanzi
    Chen, Haoshuo
    Song, Peiji
    Guo, Cheng
    Gao, Qi
    Huang, Yetian
    Fontaine, Nicolas K.
    Mazur, Mikael
    Dallachiesa, Lauren
    Ryf, Roland
    Li, Zhengxuan
    Song, Yingxiong
    2024 OPTICAL FIBER COMMUNICATIONS CONFERENCE AND EXHIBITION, OFC, 2024,
  • [49] Retargeted image quality assessment based on multi-scale distortion-aware feature
    Wu Z.
    Zhang S.
    Niu Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2019, 45 (12): : 2487 - 2494
  • [50] Distortion-Aware Concurrent Multipath Transfer for Mobile Video Streaming in Heterogeneous Wireless Networks
    Wu, Jiyan
    Cheng, Bo
    Yuen, Chau
    Shang, Yanlei
    Chen, Junliang
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2015, 14 (04) : 688 - 701