Research on Volleyball Video Intelligent Description Technology Combining the Long-Term and Short-Term Memory Network and Attention Mechanism

被引:3
|
作者
Gao, Yuhua [1 ]
Mo, Yong [2 ]
Zhang, Heng [3 ]
Huang, Ruiyin [1 ]
Chen, Zilong [1 ]
机构
[1] Guangzhou Sport Univ, Guangzhou 510500, Guangdong, Peoples R China
[2] Guangdong Baiyun Univ, Guangzhou 510450, Guangdong, Peoples R China
[3] Yingshan Cty 1 Middle Sch, Yingshan 438700, Hubei, Peoples R China
关键词
D O I
10.1155/2021/7088837
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
With the development of computer technology, video description, which combines the key technologies in the field of natural language processing and computer vision, has attracted more and more researchers' attention. Among them, how to objectively and efficiently describe high-speed and detailed sports videos is the key to the development of the video description field. In view of the problems of sentence errors and loss of visual information in the generation of the video description text due to the lack of language learning information in the existing video description methods, a multihead model combining the long-term and short-term memory network and attention mechanism is proposed for the intelligent description of the volleyball video. Through the introduction of the attention mechanism, the model pays much attention to the significant areas in the video when generating sentences. Through the comparative experiment with different models, the results show that the model with the attention mechanism can effectively solve the loss of visual information. Compared with the LSTM and base model, the multihead model proposed in this paper, which combines the long-term and short-term memory network and attention mechanism, has higher scores in all evaluation indexes and significantly improved the quality of the intelligent text description of the volleyball video.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Complex network structure influences processing in long-term and short-term memory
    Vitevitch, Michael S.
    Chan, Kit Ying
    Roodenrys, Steven
    JOURNAL OF MEMORY AND LANGUAGE, 2012, 67 (01) : 30 - 44
  • [22] Research on Video Description Based on Adaptive Frame Sampling Algorithm and Bidirectional Long Short-Term Memory
    Zhang R.
    Ning P.
    Xiao H.
    Shi J.
    Qiu W.
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2018, 46 (01): : 103 - 111
  • [23] EVIDENCE FOR SHORT-TERM AND LONG-TERM MEMORY IN MONKEYS
    MEDIN, DL
    AMERICAN JOURNAL OF PSYCHOLOGY, 1972, 85 (01): : 117 - &
  • [24] SCANNING FOR INFORMATION IN LONG-TERM AND SHORT-TERM MEMORY
    WESCOURT, KT
    ATKINSON, RC
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1973, 98 (01): : 95 - 101
  • [25] AROUSAL AND CONVERSION OF SHORT-TERM TO LONG-TERM MEMORY
    BARONDES, SH
    COHEN, HD
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1968, 61 (03) : 923 - &
  • [26] LEARNING AND LONG-TERM AND SHORT-TERM MEMORY IN COCKROACHES
    CHEN, WY
    ARANDA, LC
    LUCO, JV
    ANIMAL BEHAVIOUR, 1970, 18 (NOV) : 725 - &
  • [27] RELATION BETWEEN LONG-TERM AND SHORT-TERM MEMORY
    BADDELEY, AD
    PATTERSON, K
    BRITISH MEDICAL BULLETIN, 1971, 27 (03) : 237 - +
  • [28] UNITY OF SHORT-TERM AND LONG-TERM MEMORY MECHANISMS
    SEREDA, GK
    SNOPIK, BI
    VOPROSY PSIKHOLOGII, 1970, (06) : 60 - 74
  • [29] LONG-TERM MEDIATIONAL PROCESSES IN SHORT-TERM MEMORY
    PETRUSIC, WM
    HINDS, B
    BEHAVIOR RESEARCH METHODS & INSTRUMENTATION, 1971, 3 (04): : 183 - &
  • [30] PSYCHOLOGICAL ASPECTS OF SHORT-TERM AND LONG-TERM MEMORY
    BROADBEN.DE
    PROCEEDINGS OF THE ROYAL SOCIETY SERIES B-BIOLOGICAL SCIENCES, 1970, 175 (1041): : 333 - +