An Optimized Deep Learning Method for Video Summarization Based on the User of Interest

被引:0
|
作者
Ul Haq, Hafiz Burhan [1 ]
Suwansantisuk, Watcharapan [1 ]
Chamnongthai, Kosin [1 ]
机构
[1] King Mongkuts Univ Technol Thonburi KMUTT, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
Video summarization; deep learning; user object of interest; surveillance systems; SumMe;
D O I
10.14569/IJACSA.2023.0141027
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
video is now able to play a vital role in maintaining security and protection thanks to the advancement of digital video technology. Businesses, both private and public, employ surveillance systems to monitor and track their daily operations. As a result, video generates a significant volume of data that needs to be further processed to satisfy security protocol requirements. Analyzing video requires a lot of effort and time, as well as quick equipment. The concept of a video summary was developed in order to overcome these limitations. To work past these limitations, the concept of video summarization has emerged. In this study, a deep learning-based method for customized video summarization is presented. This research enables users to produce a video summary in accordance with the User Object of Interest (UOoI), such as a car, airplane, person, bicycle, automobile, etc. Several experiments have been conducted on the two datasets, SumMe and self-created, to assess the efficiency of the proposed method. On SumMe and the self-created dataset, the overall accuracy is 98.7% and 97.5%, respectively, with a summarization rate of 93.5% and 67.3%. Furthermore, a comparison study is done to demonstrate that our proposed method is superior to other existing methods in terms of video summarization accuracy and robustness. Additionally, a graphic user interface is created to assist the user with summarizing the video using the UOoI.
引用
收藏
页码:244 / 256
页数:13
相关论文
共 50 条
  • [41] Exploring user movie interest space: A deep learning based dynamic recommendation model
    Gan, Mingxin
    Cui, Hongfei
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 173
  • [42] A User Experience Model for Home Video Summarization
    Peng, Wei-Ting
    Huang, Wei-Jia
    Chu, Wei-Ta
    Chou, Chien-Nan
    Chang, Wen-Yan
    Chang, Chia-Han
    Hung, Yi-Ping
    [J]. ADVANCES IN MULTIMEDIA MODELING, PROCEEDINGS, 2009, 5371 : 484 - +
  • [43] Sports Video Classification Method Based on Improved Deep Learning
    Gao, Tianhao
    Zhang, Meng
    Zhu, Yifan
    Zhang, Youjian
    Pang, Xiangsheng
    Ying, Jing
    Liu, Wenming
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (02):
  • [44] A Static Video Summarization Method Based on Hierarchical Clustering
    Guimaraes, Silvio Jamil F.
    Gomes, Willer
    [J]. PROGRESS IN PATTERN RECOGNITION, IMAGE ANALYSIS, COMPUTER VISION, AND APPLICATIONS, 2010, 6419 : 46 - 54
  • [45] A deep learning method for video-based action recognition
    Zhang, Guanwen
    Rao, Yukun
    Wang, Changhao
    Zhou, Wei
    Ji, Xiangyang
    [J]. IET IMAGE PROCESSING, 2021, 15 (14) : 3498 - 3511
  • [46] Video Summarization Method Based on the Weber Local Descriptor
    Cirne, Marcos Vinicius Mussel
    Pedrini, Helio
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 1304 - 1309
  • [47] A GAN based Video Summarization Method with Representation Loss
    Lei, Zhuo
    Yu, Qiang
    Shou, Lidan
    Li, Shengquan
    Mao, Yunqing
    [J]. PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 1155 - 1159
  • [48] Unsupervised video summarization using deep Non-Local video summarization networks
    Zang, Sha-Sha
    Yu, Hui
    Song, Yan
    Zeng, Ru
    [J]. NEUROCOMPUTING, 2023, 519 : 26 - 35
  • [49] Abstractive Arabic Text Summarization Based on Deep Learning
    Wazery, Y. M.
    Saleh, Marwa E.
    Alharbi, Abdullah
    Ali, Abdelmgeid A.
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [50] Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward
    Zhou, Kaiyang
    Qiao, Yu
    Xiang, Tao
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7582 - 7589