A self-attention sequential model for long-term prediction of video streams

被引:0
|
作者
Ge, Yunfeng [1 ]
Li, Hongyan [1 ]
Shi, Keyi [1 ]
机构
[1] School of Telecommunications Engineering, Xidian University, Xi'an,710071, China
关键词
D O I
10.19665/j.issn1001-2400.20240202
中图分类号
学科分类号
摘要
Video traffic prediction is a key technology to achieve accurate transmission bandwidth allocation and improve the quality of the Internet service. However, the inherent high rate variability, long-term dependence and short-term dependence of video traffic make it difficult to make a quick, accurate and long- term prediction:because existing models for predicting sequence dependencies have a high complexity and prediction models fail quickly. Aiming at the problem of long-term prediction of video streams, a sequential self-attention model with frame structure feature embedding is proposed. The sequential self-attention model has a strong modeling ability for the nonlinear relationship of discrete data. Based on the difference of correlation between video frames, this paper applies the time series self-attention model to the long-term prediction of video traffic for the first time. The existing time series self-attention model cannot effectively represent the category features of video frames. By introducing an embedding layer based on the frame structure, the frame structure information is effectively embedded into the time series to improve the accuracy of the model. The results show that, compared with the existing long short-term memory network model and convolutional neural network model, the proposed sequential self-attention model based on frame structure feature embedding has a fast inference speed, and that the prediction accuracy is reduced by at least 32% in the mean absolute error. © 2024 ournal of Xidian University. All Rights Reserved.
引用
收藏
页码:88 / 102
相关论文
共 50 条
  • [21] Sequential Recommendation via Stochastic Self-Attention
    Fan, Ziwei
    Liu, Zhiwei
    Wang, Yu
    Wang, Alice
    Nazari, Zahra
    Zheng, Lei
    Peng, Hao
    Yu, Philip S.
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2036 - 2047
  • [22] Variational Self-attention Network for Sequential Recommendation
    Zhao, Jing
    Zhao, Pengpeng
    Zhao, Lei
    Liu, Yanchi
    Sheng, Victor S.
    Zhou, Xiaofang
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 1559 - 1570
  • [23] A self-attention model for viewport prediction based on distance constraint
    Lan, ChengDong
    Qiu, Xu
    Miao, Chenqi
    Zheng, MengTing
    VISUAL COMPUTER, 2024, 40 (09): : 5997 - 6014
  • [24] HSA: Hyperbolic Self-attention for Sequential Recommendation
    Hou, Peizhong
    Wang, Haiyang
    Li, Tianming
    Yan, Junchi
    WEB AND BIG DATA, PT III, APWEB-WAIM 2023, 2024, 14333 : 250 - 264
  • [25] Improving Self-Attention Networks With Sequential Relations
    Zheng, Zaixiang
    Huang, Shujian
    Weng, Rongxiang
    Dai, Xinyu
    Chen, Jiajun
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 1707 - 1716
  • [26] GSSTU: Generative Spatial Self-Attention Transformer Unit for Enhanced Video Prediction
    Singh, Binit
    Singh, Divij
    Kaushal, Rohan
    Halder, Agrya
    Chattopadhyay, Pratik
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 14
  • [27] Self-Attention ConvLSTM for Spatiotemporal Prediction
    Lin, Zhihui
    Li, Maomao
    Zheng, Zhuobin
    Cheng, Yangyang
    Yuan, Chun
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11531 - 11538
  • [28] A graph multi-head self-attention neural network for the multi-point long-term prediction of sea surface temperature
    Sheng, Longquan
    Xu, LingYu
    Yu, Jie
    Li, ZhuoLin
    REMOTE SENSING LETTERS, 2023, 14 (08) : 786 - 796
  • [29] LEARNING HIERARCHICAL SELF-ATTENTION FOR VIDEO SUMMARIZATION
    Liu, Yen-Ting
    Li, Yu-Jhe
    Yang, Fu-En
    Chen, Shang-Fu
    Wang, Yu-Chiang Frank
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3377 - 3381
  • [30] Session interest model for CTR prediction based on self-attention mechanism
    Wang, Qianqian
    Liu, Fang'ai
    Zhao, Xiaohui
    Tan, Qiaoqiao
    SCIENTIFIC REPORTS, 2022, 12 (01)