Benchmark three-dimensional eye-tracking dataset for visual saliency prediction on stereoscopic three-dimensional video

被引:8
|
作者
Banitalebi-Dehkordi, Amin [1 ]
Nasiopoulos, Eleni [2 ]
Pourazad, Mahsa T. [3 ,4 ]
Nasiopoulos, Panos [1 ,3 ]
机构
[1] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
[2] Univ British Columbia, Dept Psychol, 2136 W Mall, Vancouver, BC V6T 1Z4, Canada
[3] Univ British Columbia, Inst Comp Informat & Cognit Syst, Vancouver, BC V6T 1Z4, Canada
[4] TELUS Commun Inc, Vancouver, BC V6B 8N9, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
stereoscopic video; three-dimensional video; saliency prediction; visual attention modeling; eye tracking; REGION DETECTION; DETECTION MODEL; ATTENTION; IMAGE; QUALITY; FEATURES; DENSITY; SENSITIVITY; MOVEMENTS; SEARCH;
D O I
10.1117/1.JEI.25.1.013008
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Visual attention models (VAMs) predict the location of image or video regions that are most likely to attract human attention. Although saliency detection is well explored for two-dimensional (2-D) image and video content, there have been only a few attempts made to design three-dimensional (3-D) saliency prediction models. Newly proposed 3-D VAMs have to be validated over large-scale video saliency prediction datasets, which also contain results of eye-tracking information. There are several publicly available eye-tracking datasets for 2-D image and video content. In the case of 3-D, however, there is still a need for large-scale video saliency datasets for the research community for validating different 3-D VAMs. We introduce a large-scale dataset containing eye-tracking data collected from 61 stereoscopic 3-D videos (and also 2-D versions of those), and 24 subjects participated in a free-viewing test. We evaluate the performance of the existing saliency detection methods over the proposed dataset. In addition, we created an online benchmark for validating the performance of the existing 2-D and 3-D VAMs and facilitating the addition of new VAMs to the benchmark. Our benchmark currently contains 50 different VAMs. (C) 2016 SPIE and IS&T
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Evolution of stereoscopic and three-dimensional video
    Ziegler, M
    Falkenhagen, L
    ter Horst, R
    Kalivas, D
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 1998, 14 (1-2) : 173 - 194
  • [2] Three-dimensional information in face recognition: An eye-tracking study
    Chelnokova, Olga
    Laeng, Bruno
    [J]. JOURNAL OF VISION, 2011, 11 (13): : 1 - 15
  • [3] Three-dimensional stereoscopic plots
    Symanzik, Jurgen
    [J]. WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2011, 3 (06) : 483 - 496
  • [4] Three-Dimensional Stereoscopic Anatomy
    Merchant, Alan C.
    [J]. ARTHROSCOPY-THE JOURNAL OF ARTHROSCOPIC AND RELATED SURGERY, 2011, 27 (12): : 1603 - 1603
  • [5] Three-Dimensional Eye Tracking in a Surgical Scenario
    Bogdanova, Rositsa
    Boulanger, Pierre
    Zheng, Bin
    [J]. SURGICAL INNOVATION, 2015, 22 (05) : 522 - 527
  • [6] A Low-cost Eye-tracking Autostereoscopic Three-dimensional Display System
    Wang, Yuan
    Li, Mingjin
    Surman, Phil
    He, Sailing
    [J]. 2021 PHOTONICS & ELECTROMAGNETICS RESEARCH SYMPOSIUM (PIERS 2021), 2021, : 391 - 395
  • [7] Three-dimensional measurement of fluid flow by stereoscopic tracking velocimetry
    Lee, DJ
    Cha, SYS
    [J]. OPTICAL TECHNOLOGY AND IMAGE PROCESSING FOR FLUIDS AND SOLIDS DIAGNOSTICS 2002, 2002, 5058 : 73 - 85
  • [8] Object tracking with a stereoscopic camera: exploring the three-dimensional space
    Riera, J.
    Parrilla, E.
    Hueso, J. L.
    [J]. EUROPEAN JOURNAL OF PHYSICS, 2011, 32 (01) : 235 - 243
  • [9] Three-Dimensional Stereoscopic Anatomy Reply
    Cohen, Moises
    [J]. ARTHROSCOPY-THE JOURNAL OF ARTHROSCOPIC AND RELATED SURGERY, 2011, 27 (12): : 1604 - 1604
  • [10] Three-dimensional semantic object tracking in video sequences
    Gao, J
    Kosaka, A
    [J]. INTERNET IMAGING II, 2001, 4311 : 361 - 369