Video Saliency Detection Using Spatiotemporal Cues

被引:0
|
作者
Chen, Yu [1 ]
Xiao, Jing [1 ]
Hu, Liuyi [1 ]
Chen, Dan [1 ]
Wang, Zhongyuan [1 ]
Li, Dengshi [2 ]
机构
[1] Wuhan Univ, Sch Comp, Wuhan 430072, Hubei, Peoples R China
[2] Jianghan Univ, Sch Math & Comp, Wuhan 430072, Hubei, Peoples R China
来源
关键词
saliency detection; spatio-temproal cues; foreground prior; spatial distribution; background noise suppression;
D O I
10.1587/transinf.2017PCP0011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Saliency detection for videos has been paid great attention and extensively studied in recent years. However, various visual scene with complicated motions leads to noticeable background noise and non-uniformly highlighting the foreground objects. In this paper, we proposed a video saliency detection model using spatio-temporal cues. In spatial domain, the location of foreground region is utilized as spatial cue to constrain the accumulation of contrast for background regions. In temporal domain, the spatial distribution of motion-similar regions is adopted as temporal cue to further suppress the background noise. Moreover, a backward matching based temporal prediction method is developed to adjust the temporal saliency according to its corresponding prediction from the previous frame, thus enforcing the consistency along time axis. The performance evaluation on several popular benchmark data sets validates that our approach outperforms existing state-of-the-arts.
引用
收藏
页码:2201 / 2208
页数:8
相关论文
共 50 条
  • [1] Unsupervised Uncertainty Estimation Using Spatiotemporal Cues in Video Saliency Detection
    Alshawi, Tariq
    Long, Zhiling
    AlRegib, Ghassan
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) : 2818 - 2827
  • [2] Video Saliency Estimation via Encoding Deep Spatiotemporal Saliency Cues
    Jun Wang
    Chang Tian
    Lei Hu
    Wang Hai
    Zeng Mingyong
    Qing Shen
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2018,
  • [3] VIDEO SALIENCY INCORPORATING SPATIOTEMPORAL CUES AND UNCERTAINTY WEIGHTING
    Fang, Yuming
    Wang, Zhou
    Lin, Weisi
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2013), 2013,
  • [4] Video Saliency Incorporating Spatiotemporal Cues and Uncertainty Weighting
    Fang, Yuming
    Wang, Zhou
    Lin, Weisi
    Fang, Zhijun
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) : 3910 - 3921
  • [5] A spatiotemporal model for video saliency detection
    Kalboussi, Rahma
    Abdellaoui, Mehrez
    Douik, Ali
    [J]. 2016 SECOND INTERNATIONAL IMAGE PROCESSING, APPLICATIONS AND SYSTEMS (IPAS), 2016,
  • [6] A Video Saliency Detection Framework Using Spatiotemporal Consistency Optimization
    Zheng, Yunfei
    Zhang, Xiongwei
    Cao, Tieyong
    Bao, Lei
    Hu, Yonggang
    Wang, Yong
    [J]. PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 523 - 528
  • [7] UNSUPERVISED ESTIMATION OF UNCERTAINTY FOR VIDEO SALIENCY DETECTION USING TEMPORAL CUES
    Alshawi, Tariq
    Long, Zhiling
    AlRegib, Ghassan
    [J]. 2015 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2015, : 1200 - 1204
  • [8] Video Saliency Detection Using Multi-level Spatiotemporal Orientation
    Liu, Zhao
    Wang, Zhenyang
    Song, Xinhui
    Chen, Chun
    [J]. 2015 10TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING (ICICS), 2015,
  • [9] An Effective Video Saliency Detection Model Based on Human Visual Acuity and Spatiotemporal Cues in Cloud Systems
    Fang, Zhijun
    Zhang, Juan
    Wan, Wanggen
    Fang, Yuming
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2014, 15 (05): : 835 - 840
  • [10] VIDEO SALIENCY DETECTION BASED ON SPATIOTEMPORAL FEATURE LEARNING
    Lee, Se-Ho
    Kim, Jin-Hwan
    Choi, Kwang Pyo
    Sim, Jae-Young
    Kim, Chang-Su
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 1120 - 1124