An Optimized Deep Learning Method for Video Summarization Based on the User of Interest

被引:0
|
作者
Ul Haq, Hafiz Burhan [1 ]
Suwansantisuk, Watcharapan [1 ]
Chamnongthai, Kosin [1 ]
机构
[1] King Mongkuts Univ Technol Thonburi KMUTT, Fac Engn, Dept Elect & Telecommun Engn, Bangkok 10140, Thailand
关键词
Video summarization; deep learning; user object of interest; surveillance systems; SumMe;
D O I
10.14569/IJACSA.2023.0141027
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
video is now able to play a vital role in maintaining security and protection thanks to the advancement of digital video technology. Businesses, both private and public, employ surveillance systems to monitor and track their daily operations. As a result, video generates a significant volume of data that needs to be further processed to satisfy security protocol requirements. Analyzing video requires a lot of effort and time, as well as quick equipment. The concept of a video summary was developed in order to overcome these limitations. To work past these limitations, the concept of video summarization has emerged. In this study, a deep learning-based method for customized video summarization is presented. This research enables users to produce a video summary in accordance with the User Object of Interest (UOoI), such as a car, airplane, person, bicycle, automobile, etc. Several experiments have been conducted on the two datasets, SumMe and self-created, to assess the efficiency of the proposed method. On SumMe and the self-created dataset, the overall accuracy is 98.7% and 97.5%, respectively, with a summarization rate of 93.5% and 67.3%. Furthermore, a comparison study is done to demonstrate that our proposed method is superior to other existing methods in terms of video summarization accuracy and robustness. Additionally, a graphic user interface is created to assist the user with summarizing the video using the UOoI.
引用
收藏
页码:244 / 256
页数:13
相关论文
共 50 条
  • [11] Improving Video Summarization based on User Preferences
    Kannan, Rajkumar
    Ghinea, Gheorghita
    Swaminathan, Sridhar
    Kannaiyan, Suresh
    [J]. 2013 FOURTH NATIONAL CONFERENCE ON COMPUTER VISION, PATTERN RECOGNITION, IMAGE PROCESSING AND GRAPHICS (NCVPRIPG), 2013,
  • [12] Egocentric Video Summarization Based on People Interaction Using Deep Learning
    Ghafoor, Humaira A.
    Javed, Ali
    Irtaza, Aun
    Dawood, Hassan
    Dawood, Hussain
    Banjar, Ameen
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2018, 2018
  • [13] A UNIFIED VIDEO SUMMARIZATION FOR VIDEO ANOMALIES THROUGH DEEP LEARNING
    Muchtar, Kahlil
    Munggaran, Muhammad Rizky
    Mahendra, Adhiguna
    Anwar, Khairul
    Lin, Chih-Yang
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [14] Gaze Aware Deep Learning Model for Video Summarization
    Wu, Jiaxin
    Zhong, Sheng-hua
    Ma, Zheng
    Heinen, Stephen J.
    Jiang, Jianmin
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 285 - 295
  • [15] Deep Attentive Video Summarization With Distribution Consistency Learning
    Ji, Zhong
    Zhao, Yuxiao
    Pang, Yanwei
    Li, Xi
    Han, Jungong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (04) : 1765 - 1775
  • [16] Video Summarization by Learning Deep Side Semantic Embedding
    Yuan, Yitian
    Mei, Tao
    Cui, Peng
    Zhu, Wenwu
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (01) : 226 - 237
  • [17] Deep Reinforcement Learning for Video Summarization with Semantic Reward
    Sun, Haoran
    Zhu, Xiaolong
    Zhou, Conghua
    [J]. 2022 IEEE 22ND INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY, AND SECURITY COMPANION, QRS-C, 2022, : 754 - 755
  • [18] Dynamic and Personalized Video Summarization Based on User Preferences
    Narwal, Pulkit
    Duhan, Neelam
    Bhatia, Komal Kumar
    [J]. COMMUNICATION AND INTELLIGENT SYSTEMS, VOL 1, ICCIS 2023, 2024, 967 : 19 - 36
  • [19] New optimized and filtering method of user's interest
    School of Computer, Beijing Institute of Technology, Beijing 100081, China
    不详
    [J]. Jisuanji Gongcheng, 2006, 20 (10-12):
  • [20] A Video Summarization Model Based on Deep Reinforcement Learning with Long-Term Dependency
    Wang, Xu
    Li, Yujie
    Wang, Haoyu
    Huang, Longzhao
    Ding, Shuxue
    [J]. SENSORS, 2022, 22 (19)