TRANSFER LEARNING WITH DEEP NETWORKS FOR SALIENCY PREDICTION IN NATURAL VIDEO

被引:0
|
作者
Chaabouni, Souad [1 ]
Benois-Pineau, Jenny [1 ]
Ben Amari, Chokri [2 ]
机构
[1] Univ Bordeaux, LaBRI UMR 5800, 351 Crs Liberat, F-33405 Talence, France
[2] Univ Sfax, Natl Engn Sch Sfax, REGIM Lab LR11ES48, BP1173, Sfax 3038, Tunisia
关键词
Transfer learning; deep learning; saliency map; visual attention; residual motion;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The main purpose of transfer learning is to resolve the problem of different data distribution, generally, when the training samples of source domain are different from the training samples of the target domain. Prediction of salient areas in natural video suffers from the lack of large video benchmarks with human gaze fixations. Different databases only provide dozens up to one or two hundred of videos. The only public large database is HOLLYWOOD with 1707 videos available with gaze recordings. The main idea of this paper is to transfer the knowledge learned with the deep network on a large dataset to train the network on a small dataset to predict salient areas. The results show an improvement on two small publicly available video datasets.
引用
收藏
页码:1604 / 1608
页数:5
相关论文
共 50 条
  • [1] Revisiting Video Saliency Prediction in the Deep Learning Era
    Wang, Wenguan
    Shen, Jianbing
    Xie, Jianwen
    Cheng, Ming-Ming
    Ling, Haibin
    Borji, Ali
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 220 - 237
  • [2] Deep Saliency Features for Video Saliency Prediction
    Azaza, Aymen
    Douik, Ali
    [J]. 2018 INTERNATIONAL CONFERENCE ON ADVANCED SYSTEMS AND ELECTRICAL TECHNOLOGIES (IC_ASET), 2017, : 335 - 339
  • [3] DeepVS: A Deep Learning Based Video Saliency Prediction Approach
    Jiang, Lai
    Xu, Mai
    Liu, Tie
    Qiao, Minglang
    Wang, Zulin
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 625 - 642
  • [4] Learning Coupled Convolutional Networks Fusion for Video Saliency Prediction
    Wu, Zhe
    Su, Li
    Huang, Qingming
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 2960 - 2971
  • [5] ChaboNet : Design of a deep CNN for prediction of visual saliency in natural video
    Chaabouni, Souad
    Benois-Pineau, Jenny
    Ben Amar, Chokri
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 60 : 79 - 93
  • [6] Prediction of visual saliency in video with deep CNNs
    Chaabouni, Souad
    Benois-Pineau, Jenny
    Hadar, Ofer
    [J]. APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXIX, 2016, 9971
  • [7] Learn to Look Around: Deep Reinforcement Learning Agent for Video Saliency Prediction
    Tao, Yiran
    Hu, Yaosi
    Chen, Zhenzhong
    [J]. 2021 INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2021,
  • [8] Shallow and Deep Convolutional Networks for Saliency Prediction
    Pan, Junting
    Sayrol, Elisa
    Giro-I-Nieto, Xavier
    McGuinness, Kevin
    O'Connor, Noel E.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 598 - 606
  • [9] Visual Saliency Prediction Based on Deep Learning
    Ghariba, Bashir
    Shehata, Mohamed S.
    McGuire, Peter
    [J]. INFORMATION, 2019, 10 (08)
  • [10] Audiovisual saliency prediction via deep learning
    Chen, Jiazhong
    Li, Qingqing
    Ling, Hefei
    Ren, Dakai
    Duan, Ping
    [J]. NEUROCOMPUTING, 2021, 428 : 248 - 258