Unsupervised Video Prediction Network with Spatio-temporal Deep Features

被引:0
|
作者
Jin, Beibei [1 ]
Zhou, Rong [2 ]
Zhang, Zhisheng [2 ]
Dai, Min [2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing, Peoples R China
[2] Southeast Univ, Mech Engn Sch, Nanjing, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
video prediction; deep learning; robotics; unsupervised;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predicting the future states of things is an important performance form of intelligence and it is also of vital importance in real-time systems such as autonomous cars and robotics. This paper aims to tackle a video prediction task. Previous methods for future frame prediction are always subject to restrictions from environment, leading to poor accuracy and blurry prediction details. In this work, we present an unsupervised video prediction framework which iteratively anticipates the raw RGB pixel values in future video frames. Extensive experiments are implemented on advanced datasets-KTH and KITTI. The results demonstrate that our method achieves a good performance.
引用
收藏
页码:19 / 24
页数:6
相关论文
共 50 条
  • [1] Video object segmentation using spatio-temporal deep network
    Ramaswamy, Akshaya
    Gubbi, Jayavardhana
    Balamuralidhar, P.
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Spatio-temporal prediction and reconstruction network for video anomaly detection
    Liu, Ting
    Zhang, Chengqing
    Niu, Xiaodong
    Wang, Liming
    PLOS ONE, 2022, 17 (05):
  • [3] Unsupervised Video Hashing by Exploiting Spatio-Temporal Feature
    Ma, Chao
    Gu, Yun
    Liu, Wei
    Yang, Jie
    He, Xiangjian
    NEURAL INFORMATION PROCESSING, ICONIP 2016, PT III, 2016, 9949 : 511 - 518
  • [4] Spatio-Temporal Self-Attention Network for Video Saliency Prediction
    Wang, Ziqiang
    Liu, Zhi
    Li, Gongyang
    Wang, Yang
    Zhang, Tianhong
    Xu, Lihua
    Wang, Jijun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1161 - 1174
  • [5] DANet: A spatio-temporal dynamics and Detail Aware Network for video prediction
    Huang, Huilin
    Guan, YePeng
    NEUROCOMPUTING, 2024, 598
  • [6] Video Fingerprint Algorithm Based on Spatio-Temporal Deep Neural Network
    Wang Dongdong
    Li Yuenan
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (01)
  • [7] Interpolating Deep Spatio-Temporal Inference Network Features for Image Classification
    Zhang, Yongfeng
    Shang, Changjing
    Shen, Qiang
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 1819 - 1826
  • [8] Flexible Spatio-Temporal Networks for Video Prediction
    Lu, Chaochao
    Hirsch, Michael
    Scholkopf, Bernhard
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2137 - 2145
  • [9] Particle swarm optimized deep spatio-temporal features for efficient video retrieval
    Banerjee A.
    Kumar E.
    Ravinder M.
    International Journal of Information Technology, 2024, 16 (3) : 1763 - 1768
  • [10] Deep spatio-temporal graph convolutional network for traffic accident prediction
    Yu, Le
    Du, Bowen
    Hu, Xiao
    Sun, Leilei
    Han, Liangzhe
    Lv, Weifeng
    NEUROCOMPUTING, 2021, 423 (423) : 135 - 147