An Optimized Deep Learning Method for Video Summarization Based on the User of Interest

被引:0
|
作者
Ul Haq, Hafiz Burhan [1 ]
Suwansantisuk, Watcharapan [1 ]
Chamnongthai, Kosin [1 ]
机构
[1] King Mongkuts Univ Technol Thonburi KMUTT, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
Video summarization; deep learning; user object of interest; surveillance systems; SumMe;
D O I
10.14569/IJACSA.2023.0141027
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
video is now able to play a vital role in maintaining security and protection thanks to the advancement of digital video technology. Businesses, both private and public, employ surveillance systems to monitor and track their daily operations. As a result, video generates a significant volume of data that needs to be further processed to satisfy security protocol requirements. Analyzing video requires a lot of effort and time, as well as quick equipment. The concept of a video summary was developed in order to overcome these limitations. To work past these limitations, the concept of video summarization has emerged. In this study, a deep learning-based method for customized video summarization is presented. This research enables users to produce a video summary in accordance with the User Object of Interest (UOoI), such as a car, airplane, person, bicycle, automobile, etc. Several experiments have been conducted on the two datasets, SumMe and self-created, to assess the efficiency of the proposed method. On SumMe and the self-created dataset, the overall accuracy is 98.7% and 97.5%, respectively, with a summarization rate of 93.5% and 67.3%. Furthermore, a comparison study is done to demonstrate that our proposed method is superior to other existing methods in terms of video summarization accuracy and robustness. Additionally, a graphic user interface is created to assist the user with summarizing the video using the UOoI.
引用
收藏
页码:244 / 256
页数:13
相关论文
共 50 条
  • [1] LEARNING DEEP SEMANTIC ATTRIBUTES FOR USER VIDEO SUMMARIZATION
    Sun, Ke
    Zhu, Jiasong
    Lei, Zhuo
    Hou, Xianxu
    Zhang, Qian
    Duan, Jiang
    Qiu, Guoping
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 643 - 648
  • [2] An Effective Video Summarization Framework Based on the Object of Interest Using Deep Learning
    Ul Haq, Hafiz Burhan
    Asif, Muhammad
    Ahmad, Maaz Bin
    Ashraf, Rehan
    Mahmood, Toqeer
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [3] Optimized deep learning enabled lecture audio video summarization
    Chandan Kaur, Preet
    Ragha, Dr. Leena
    [J]. Journal of Visual Communication and Image Representation, 2024, 104
  • [4] Object of Interest and Unsupervised Learning-based Framework for an Effective Video Summarization Using Deep Learning
    Negi, Alok
    Kumar, Krishan
    Saini, Parul
    [J]. IETE JOURNAL OF RESEARCH, 2024, 70 (05) : 5019 - 5030
  • [5] Learning user interest with improved triplet deep ranking and web-image priors for topic-related video summarization
    Fei, Mengjuan
    Jiang, Wei
    Mao, Weijie
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 166
  • [6] A Deep Learning Method Study of User Interest Classification
    Malafeev, Alexey
    Nikolaev, Kirill
    [J]. ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS (AIST 2019), 2020, 1086 : 154 - 159
  • [7] Unsupervised Video Summarization Based on Deep Reinforcement Learning with Interpolation
    Yoon, Ui Nyoung
    Hong, Myung Duk
    Jo, Geun-Sik
    [J]. SENSORS, 2023, 23 (07)
  • [8] An optimized approach for multi-user facial expression-based video summarization
    Ashokkumar, S.
    Suresh, A.
    Priya, S.
    Dhanasekaran, R.
    [J]. BIOMEDICAL RESEARCH-INDIA, 2016, 27 : S293 - S305
  • [9] Lecture Video Summarization Using Deep Learning
    Khetarpaul, Sonia
    Jain, Lakshay
    Goyal, Kush
    Tej, P. Vishnu
    [J]. RECENT CHALLENGES IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, PT II, ACIIDS 2024, 2024, 2145 : 94 - 105
  • [10] Soccer Video Summarization using Deep Learning
    Agyeman, Rockson
    Muhammad, Rafiq
    Choi, Gyu Sang
    [J]. 2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 270 - 273