TRANSFER LEARNING WITH DEEP NETWORKS FOR SALIENCY PREDICTION IN NATURAL VIDEO

被引:0
|
作者
Chaabouni, Souad [1 ]
Benois-Pineau, Jenny [1 ]
Ben Amari, Chokri [2 ]
机构
[1] Univ Bordeaux, LaBRI UMR 5800, 351 Crs Liberat, F-33405 Talence, France
[2] Univ Sfax, Natl Engn Sch Sfax, REGIM Lab LR11ES48, BP1173, Sfax 3038, Tunisia
关键词
Transfer learning; deep learning; saliency map; visual attention; residual motion;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The main purpose of transfer learning is to resolve the problem of different data distribution, generally, when the training samples of source domain are different from the training samples of the target domain. Prediction of salient areas in natural video suffers from the lack of large video benchmarks with human gaze fixations. Different databases only provide dozens up to one or two hundred of videos. The only public large database is HOLLYWOOD with 1707 videos available with gaze recordings. The main idea of this paper is to transfer the knowledge learned with the deep network on a large dataset to train the network on a small dataset to predict salient areas. The results show an improvement on two small publicly available video datasets.
引用
收藏
页码:1604 / 1608
页数:5
相关论文
共 50 条
  • [31] SSPNet: Learning spatiotemporal saliency prediction networks for visual tracking q
    Lee, Hyeonseok
    Kim, Sungchan
    [J]. INFORMATION SCIENCES, 2021, 575 : 399 - 416
  • [32] Leveraging transfer learning with deep learning for crime prediction
    Butt, Umair Muneer
    Letchmunan, Sukumar
    Hassan, Fadratul Hafinaz
    Koh, Tieng Wei
    [J]. PLOS ONE, 2024, 19 (04):
  • [33] Accurate Prediction of Streaming Video Traffic in TCP/IP Networks using DPI and Deep Learning
    Aziz, Waqar Ali
    Qureshi, Hassaan Khaliq
    Iqbal, Adnan
    Lestas, Marios
    [J]. 2020 16TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC, 2020, : 310 - 315
  • [34] SALICON: Reducing the Semantic Gap in Saliency Prediction by Adapting Deep Neural Networks
    Huang, Xun
    Shen, Chengyao
    Boix, Xavier
    Zhao, Qi
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 262 - 270
  • [35] Video Saliency Estimation via Encoding Deep Spatiotemporal Saliency Cues
    Jun Wang
    Chang Tian
    Lei Hu
    Wang Hai
    Zeng Mingyong
    Qing Shen
    [J]. 2018 10TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2018,
  • [36] Backdoor Attacks on Deep Neural Networks via Transfer Learning from Natural Images
    Matsuo, Yuki
    Takemoto, Kazuhiro
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (24):
  • [37] Video smoke detection with domain knowledge and transfer learning from deep convolutional neural networks
    Jia, Yang
    Chen, Weiguang
    Yang, Manjiang
    Wang, Liangwu
    Liu, Dongcai
    Zhang, Qixing
    [J]. OPTIK, 2021, 240 (240):
  • [38] Short-term Traffic Prediction with Deep Neural Networks and Adaptive Transfer Learning
    Li, Junyi
    Guo, Fangce
    Wang, Yibing
    Zhang, Lihui
    Na, Xiaoxiang
    Hu, Simon
    [J]. 2020 IEEE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2020,
  • [39] The Visual Saliency Transformer Goes Temporal: TempVST for Video Saliency Prediction
    Lazaridis, Nikos
    Georgiadis, Kostas
    Kalaganis, Fotis
    Kordopatis-Zilos, Giorgos
    Papadopoulos, Symeon
    Nikolopoulos, Spiros
    Kompatsiaris, Ioannis
    [J]. IEEE ACCESS, 2024, 12 : 129705 - 129716
  • [40] Transfer learning for short-term wind speed prediction with deep neural networks
    Hu, Qinghua
    Zhang, Rujia
    Zhou, Yucan
    [J]. RENEWABLE ENERGY, 2016, 85 : 83 - 95