Research on Volleyball Video Intelligent Description Technology Combining the Long-Term and Short-Term Memory Network and Attention Mechanism

被引:3
|
作者
Gao, Yuhua [1 ]
Mo, Yong [2 ]
Zhang, Heng [3 ]
Huang, Ruiyin [1 ]
Chen, Zilong [1 ]
机构
[1] Guangzhou Sport Univ, Guangzhou 510500, Guangdong, Peoples R China
[2] Guangdong Baiyun Univ, Guangzhou 510450, Guangdong, Peoples R China
[3] Yingshan Cty 1 Middle Sch, Yingshan 438700, Hubei, Peoples R China
关键词
D O I
10.1155/2021/7088837
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the development of computer technology, video description, which combines the key technologies in the field of natural language processing and computer vision, has attracted more and more researchers' attention. Among them, how to objectively and efficiently describe high-speed and detailed sports videos is the key to the development of the video description field. In view of the problems of sentence errors and loss of visual information in the generation of the video description text due to the lack of language learning information in the existing video description methods, a multihead model combining the long-term and short-term memory network and attention mechanism is proposed for the intelligent description of the volleyball video. Through the introduction of the attention mechanism, the model pays much attention to the significant areas in the video when generating sentences. Through the comparative experiment with different models, the results show that the model with the attention mechanism can effectively solve the loss of visual information. Compared with the LSTM and base model, the multihead model proposed in this paper, which combines the long-term and short-term memory network and attention mechanism, has higher scores in all evaluation indexes and significantly improved the quality of the intelligent text description of the volleyball video.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Attention problems, phonological short-term memory, and visuospatial short-term memory: Differential effects on near- and long-term scholastic achievement
    Sarver, Dustin E.
    Rapport, Mark D.
    Kofler, Michael J.
    Scanlan, Sean W.
    Raiker, Joseph S.
    Altro, Thomas A.
    Bolden, Jennifer
    LEARNING AND INDIVIDUAL DIFFERENCES, 2012, 22 (01) : 8 - 19
  • [32] DISTINCTION BETWEEN SHORT-TERM AND LONG-TERM MEMORY
    GRUNEBER.MM
    BULLETIN OF THE BRITISH PSYCHOLOGICAL SOCIETY, 1972, 25 (87): : 151 - 151
  • [33] EFFECT OF AROUSAL ON SHORT-TERM AND LONG-TERM MEMORY
    LAVACH, JF
    JOURNAL OF EDUCATIONAL RESEARCH, 1973, 67 (03): : 131 - 133
  • [34] Effect of corticosteroids on short-term and long-term memory
    Brunner, R
    Schaefer, D
    Hess, K
    Parzer, P
    Resch, F
    Schwab, S
    NEUROLOGY, 2005, 64 (02) : 335 - 337
  • [35] Retrospective Attention in Short-Term Memory Has a Lasting Effect on Long-Term Memory Across Age
    Strunk, Jonathan
    Morgan, Lauren
    Reaves, Sarah
    Verhaeghen, Paul
    Duarte, Audrey
    JOURNALS OF GERONTOLOGY SERIES B-PSYCHOLOGICAL SCIENCES AND SOCIAL SCIENCES, 2019, 74 (08): : 1317 - 1325
  • [36] Multi-scale network traffic prediction based on attention mechanism and long short-term memory network
    Qian, Tang
    Liu, Yang
    Chao, Ma
    Yifei, Wei
    Journal of China Universities of Posts and Telecommunications, 2024, 31 (06): : 26 - 34
  • [37] Multi-scale network traffic prediction based on attention mechanism and long short-term memory network
    Tang Qian
    Yang Liu
    Ma Chao
    Wei Yifei
    The Journal of China Universities of Posts and Telecommunications, 2024, 31 (06) : 26 - 34+56
  • [38] Short-Term Load Forecasting using A Long Short-Term Memory Network
    Liu, Chang
    Jin, Zhijian
    Gu, Jie
    Qiu, Caiming
    2017 IEEE PES INNOVATIVE SMART GRID TECHNOLOGIES CONFERENCE EUROPE (ISGT-EUROPE), 2017,
  • [39] DevsNet: Deep Video Saliency Network using Short-term and Long-term Cues
    Fang, Yuming
    Zhang, Chi
    Min, Xiongkuo
    Huang, Hanqin
    Yi, Yugen
    Zhai, Guangtao
    Lin, Chia-Wen
    PATTERN RECOGNITION, 2020, 103 (103)
  • [40] Long-Term Prediction of Multistress Accelerated Aging of Capacitors by Long Short-Term Memory Network
    Liu, Hao
    Claeys, Tim
    Pissoort, Davy
    Vandenbosch, Guy A. E.
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72