CUDAS: Distortion-Aware Saliency Benchmark

被引:1
|
作者
Zhao, Xin [1 ]
Lou, Jianxun [1 ]
Wu, Xinbo [1 ]
Wu, Yingying [1 ]
Leveque, Lucie [2 ]
Liu, Xiaochang [3 ]
Guo, Pengfei [4 ]
Qin, Yipeng [1 ]
Lin, Hanhe [5 ]
Saupe, Dietmar [6 ]
Liu, Hantao [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF24 4AG, Wales
[2] Nantes Univ, UMR CNRS LS2N 6004, F-44000 Nantes, France
[3] Sun Yat Sen Univ, Sch Mat, Guangzhou 510275, Peoples R China
[4] Zhongkai Univ Agr & Engn, Sch Computat Sci, Guangzhou 510225, Peoples R China
[5] Univ Dundee, Sch Sci & Engn, Dundee DD1 4HN, Scotland
[6] Univ Konstanz, Dept Comp & Informat Sci, D-78457 Constance, Germany
关键词
Eye-tracking; saliency; distortion; image quality; deep learning; ENCODER-DECODER NETWORK; VISUAL-ATTENTION; BOTTOM-UP; EYE-TRACKING; MODEL;
D O I
10.1109/ACCESS.2023.3283344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual saliency prediction remains an academic challenge due to the diversity and complexity of natural scenes as well as the scarcity of eye movement data on where people look in images. In many practical applications, digital images are inevitably subject to distortions, such as those caused by acquisition, editing, compression or transmission. A great deal of attention has been paid to predicting the saliency of distortion-free pristine images, but little attention has been given to understanding the impact of visual distortions on saliency prediction. In this paper, we first present the CUDAS database - a new distortion-aware saliency benchmark, where eye-tracking data was collected for 60 pristine images and their corresponding 540 distorted formats. We then conduct a statistical evaluation to reveal the behaviour of state-of-the-art saliency prediction models on distorted images and provide insights on building an effective model for distortion-aware saliency prediction. The new database is made publicly available to the research community.
引用
收藏
页码:58025 / 58036
页数:12
相关论文
共 50 条
  • [21] OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer
    Yu, Fanghua
    Wang, Xintao
    Cao, Mingdeng
    Li, Gen
    Shan, Ying
    Dong, Chao
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 13283 - 13292
  • [22] A Distortion-Aware Intelligent Context-Aggregation Agent for Smart Environments
    Chen, Huan
    Cheng, Chih-Chuan
    IEEE INTELLIGENT SYSTEMS, 2011, 26 (03) : 42 - 49
  • [23] Distortion-aware image retargeting based on continuous seam carving model
    Cui, Jia
    Cai, Qianqian
    Lu, Hongju
    Jia, Zhenlin
    Tang, Mingxi
    SIGNAL PROCESSING, 2020, 166
  • [24] An Iterative Distortion-Aware Precoding for Quantized Upsampled Wideband Massive MIMO
    Karabacakoglu, Yusuf
    Ucuncu, Ali Bulut
    Guvensen, Gokhan M.
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 6498 - 6503
  • [25] DA Wand: Distortion-Aware Selection using Neural Mesh Parameterization
    Liu, Richard
    Aigerman, Noam
    Kim, Vladimir G.
    Hanocka, Rana
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16739 - 16749
  • [26] Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation
    Zhang, Jiaming
    Yang, Kailun
    Ma, Chaoxiang
    Reiss, Simon
    Peng, Kunyu
    Stiefelhagen, Rainer
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 16896 - 16906
  • [27] Lightweight Distortion-Aware Network for Salient Object Detection in Omnidirectional Images
    Huang, Mengke
    Li, Gongyang
    Liu, Zhi
    Zhu, Linchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 6191 - 6197
  • [28] DISTORTION-AWARE JOINT SCHEDULING AND RESOURCE ALLOCATION FOR WIRELESS VIDEO TRANSMISSION
    Katsenou, Angeliki V.
    Kondi, Lisimachos P.
    Papapetrou, Evangelos
    2013 PROCEEDINGS OF THE 21ST EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2013,
  • [29] Distortion-Aware Dynamic Channel Allocation for Multimedia Users in Cognitive Radios
    Thanh-Tung Nguyen
    Koo, Insoo
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2014, E97B (12) : 2790 - 2799
  • [30] Nonlinear Distortion-Aware Interference Alignment for Ultra-Dense Networks
    Villalonga, David Alejandro Urquiza
    Castanheira, Daniel
    Silva, Adao
    Garcia, M. Julia Fernandez-Getino
    Gameiro, Atilio
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (11) : 7108 - 7123