Optimized deep learning enabled lecture audio video summarization

被引:0
|
作者
Chandan Kaur, Preet [1 ]
Ragha, Dr. Leena [1 ,2 ]
机构
[1] Computer Engineering/Faculty, Ramrao Adik Institute of Technology, D.Y PATIL Deemed to be a University, Nerul, Maharashtra, Navi Mumbai,400706, India
[2] Department of Computer Science and Engineering, BLDEA's V.P. Dr. P. G. Halakatti College of Engineering Technology, Ashram Road, Karnataka, Vijayapur,586103, India
关键词
Deep learning - Image segmentation;
D O I
10.1016/j.jvcir.2024.104309
中图分类号
学科分类号
摘要
Video summarization plays an important role in multiple applications by compressing lengthy video content into compressed representation. The purpose is to present a fine-tuned deep model for lecture audio video summarization. Initially, the input lecture audio-visual video is taken from the dataset. Then, the video shot segmentation (slide segmentation) is done using the YCbCr space colour model. From each video shot, the audio and video within the video shot are segmented using the Honey Badger-based Bald Eagle Algorithm (HBBEA). The HBBEA is obtained by combining the Bald Eagle Search (BES) and Honey Badger Algorithm (HBA). The DRN training is executed by HBBEA to select the finest DRN weights. The relevant video frames are merged with the audio. The proposed HBBEA-based DRN outperformed with a better F1-Score of 91.9 %, Negative predictive value (NPV) of 89.6 %, Positive predictive value (PPV) of 90.7 %, Accuracy of 91.8 %, precision of 91 %, and recall of 92.8 %. © 2024 Elsevier Inc.
引用
收藏
相关论文
共 50 条
  • [1] Lecture Video Summarization Using Deep Learning
    Khetarpaul, Sonia
    Jain, Lakshay
    Goyal, Kush
    Tej, P. Vishnu
    RECENT CHALLENGES IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, PT II, ACIIDS 2024, 2024, 2145 : 94 - 105
  • [2] An Optimized Deep Learning Method for Video Summarization Based on the User of Interest
    Ul Haq, Hafiz Burhan
    Suwansantisuk, Watcharapan
    Chamnongthai, Kosin
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (10) : 244 - 256
  • [3] Video Lecture Summarization System
    Agrawal, Sujal
    Tirpude, Shubhangi
    INTERNATIONAL JOURNAL OF NEXT-GENERATION COMPUTING, 2022, 13 (05): : 1091 - 1097
  • [4] ROLE OF AUDIO IN VIDEO SUMMARIZATION
    Shoer, Ibrahim
    Kopru, Berkay
    Erzin, Engin
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [5] Soccer Video Summarization using Deep Learning
    Agyeman, Rockson
    Muhammad, Rafiq
    Choi, Gyu Sang
    2019 2ND IEEE CONFERENCE ON MULTIMEDIA INFORMATION PROCESSING AND RETRIEVAL (MIPR 2019), 2019, : 270 - 273
  • [6] A UNIFIED VIDEO SUMMARIZATION FOR VIDEO ANOMALIES THROUGH DEEP LEARNING
    Muchtar, Kahlil
    Munggaran, Muhammad Rizky
    Mahendra, Adhiguna
    Anwar, Khairul
    Lin, Chih-Yang
    2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [7] Blockchain-enabled deep semantic video-to-video summarization for IoT devices
    Khan, Gulraiz
    Jabeen, Saira
    Khan, Muhammad Zeeshan
    Khan, Muhammad Usman Ghani
    Iqbal, Razi
    COMPUTERS & ELECTRICAL ENGINEERING, 2020, 81
  • [8] An Audio-video Summarization Scheme Based on Audio and Video Analysis
    Furini, Marco
    Ghini, Vittorio
    2006 3RD IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2006, : 1209 - +
  • [9] Gaze Aware Deep Learning Model for Video Summarization
    Wu, Jiaxin
    Zhong, Sheng-hua
    Ma, Zheng
    Heinen, Stephen J.
    Jiang, Jianmin
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2018, PT II, 2018, 11165 : 285 - 295
  • [10] LEARNING DEEP SEMANTIC ATTRIBUTES FOR USER VIDEO SUMMARIZATION
    Sun, Ke
    Zhu, Jiasong
    Lei, Zhuo
    Hou, Xianxu
    Zhang, Qian
    Duan, Jiang
    Qiu, Guoping
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 643 - 648