CUDAS: Distortion-Aware Saliency Benchmark

被引:1
|
作者
Zhao, Xin [1 ]
Lou, Jianxun [1 ]
Wu, Xinbo [1 ]
Wu, Yingying [1 ]
Leveque, Lucie [2 ]
Liu, Xiaochang [3 ]
Guo, Pengfei [4 ]
Qin, Yipeng [1 ]
Lin, Hanhe [5 ]
Saupe, Dietmar [6 ]
Liu, Hantao [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci & Informat, Cardiff CF24 4AG, Wales
[2] Nantes Univ, UMR CNRS LS2N 6004, F-44000 Nantes, France
[3] Sun Yat Sen Univ, Sch Mat, Guangzhou 510275, Peoples R China
[4] Zhongkai Univ Agr & Engn, Sch Computat Sci, Guangzhou 510225, Peoples R China
[5] Univ Dundee, Sch Sci & Engn, Dundee DD1 4HN, Scotland
[6] Univ Konstanz, Dept Comp & Informat Sci, D-78457 Constance, Germany
关键词
Eye-tracking; saliency; distortion; image quality; deep learning; ENCODER-DECODER NETWORK; VISUAL-ATTENTION; BOTTOM-UP; EYE-TRACKING; MODEL;
D O I
10.1109/ACCESS.2023.3283344
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual saliency prediction remains an academic challenge due to the diversity and complexity of natural scenes as well as the scarcity of eye movement data on where people look in images. In many practical applications, digital images are inevitably subject to distortions, such as those caused by acquisition, editing, compression or transmission. A great deal of attention has been paid to predicting the saliency of distortion-free pristine images, but little attention has been given to understanding the impact of visual distortions on saliency prediction. In this paper, we first present the CUDAS database - a new distortion-aware saliency benchmark, where eye-tracking data was collected for 60 pristine images and their corresponding 540 distorted formats. We then conduct a statistical evaluation to reveal the behaviour of state-of-the-art saliency prediction models on distorted images and provide insights on building an effective model for distortion-aware saliency prediction. The new database is made publicly available to the research community.
引用
收藏
页码:58025 / 58036
页数:12
相关论文
共 50 条
  • [1] TranSalNet plus : Distortion-aware saliency prediction
    Lou, Jianxun
    Wu, Xinbo
    Corcoran, Padraig
    Rosin, Paul L.
    Liu, Hantao
    NEUROCOMPUTING, 2024, 600
  • [2] Distortion-Aware Correlation Tracking
    Li, Hanhui
    Wu, Hefeng
    Zhang, Huifang
    Lin, Shujin
    Luo, Xiaonan
    Wang, Ruomei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (11) : 5421 - 5434
  • [3] Distortion-aware CNNs for Spherical Images
    Zhao, Qiang
    Zhu, Chen
    Dai, Feng
    Ma, Yike
    Jin, Guoqing
    Zhang, Yongdong
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 1198 - 1204
  • [4] Distortion-Aware Transmission in Cognitive Radio Networks
    Chatterjee, Debdeep
    Oyman, Ozgur
    Foerster, Jeffrey
    2010 CONFERENCE RECORD OF THE FORTY FOURTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2010, : 1191 - 1195
  • [5] GreedyFool: Distortion-Aware Sparse Adversarial Attack
    Dong, Xiaoyi
    Chen, Dongdong
    Bao, Jianmin
    Qin, Chuan
    Yuan, Lu
    Zhang, Weiming
    Yu, Nenghai
    Chen, Dong
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] Distortion-aware Transformer in 360° Salient Object Detection
    Zhao, Yinjie
    Zhao, Lichen
    Yu, Qian
    Sheng, Lu
    Zhang, Jing
    Xu, Dong
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 499 - 508
  • [7] Distortion-Aware Monocular Depth Estimation for Omnidirectional Images
    Chen, Hong-Xiang
    Li, Kunhong
    Fu, Zhiheng
    Li, Mengyi
    Chen, Zonghao
    Guo, Yulan
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 (28) : 334 - 338
  • [8] Color Distortion-Aware Error Control for Backlight Dimming
    Kang, Suk-Ju
    Bae, Sungwoo
    Yun, Jae-Jung
    Lee, Moo-Yeon
    JOURNAL OF DISPLAY TECHNOLOGY, 2015, 11 (01): : 79 - 85
  • [9] A distortion-aware scheduling approach for wireless sensor networks
    Liaskovitis, Periklis
    Schurgers, Curt
    DISTRIBUTED COMPUTING IN SENSOR SYSTEMS, PROCEEDINGS, 2006, 4026 : 372 - 388
  • [10] Distortion-Aware Scalable Video Streaming to Multinetwork Clients
    Freris, Nikolaos M.
    Hsu, Cheng-Hsin
    Singh, Jatinder Pal
    Zhu, Xiaoqing
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2013, 21 (02) : 469 - 481