Video summarization for event-centric videos

被引:1
|
作者
Li, Qingwen [1 ]
Chen, Jianni [1 ]
Xie, Qiqin [2 ]
Han, Xiao [1 ]
机构
[1] Shanghai Univ Finance & Econ, 777 Guoding Rd, Shanghai 200433, Peoples R China
[2] Shanghai Univ, 99 Shangda Rd, Shanghai 200444, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Event -centric videos; Video summarization; Deep learning; NETWORK;
D O I
10.1016/j.neunet.2023.01.047
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video summarization has long been used to ease video browsing and plays a more crucial role with the explosion of online videos. In the context of event-centric videos, we aim to extract the corresponding clips of more important events in the video. To tackle the dilemma between the detection precision and the clip completeness faced by previous methods, we present an efficient Boundary -Aware framework for Summary clip Extraction (BASE) to extract summary clips with more precise boundaries while maintaining their completeness. Specifically, we propose a new distance-based importance signal to reflect the progress information in each video. The signal can not only help us to detect boundaries with higher precision, but also make it possible to preserve the clip completeness. For the feature presentation part, we also explore new information types to facilitate video summarization. Our approach outperforms current state-of-the-art video summarization models in terms of more precise clip boundaries and more complete summary clips. Note that we even yield comparable results to manual annotations. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:359 / 370
页数:12
相关论文
共 50 条
  • [1] Event-Centric Hierarchical Representation for Dense Video Captioning
    Wang, Teng
    Zheng, Huicheng
    Yu, Mingjing
    Tian, Qian
    Hu, Haifeng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1890 - 1900
  • [2] Video Summarization: Survey on Event Detection and Summarization in Soccer Videos
    Khan, Yasmin S.
    Pawar, Soudamini
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2015, 6 (11) : 256 - 259
  • [3] Event-centric media management
    Scherp, Ansgar
    Agaram, Srikanih
    Jain, Ramesh
    [J]. MULTIMEDIA CONTENT ACCESS: ALGORITHMS AND SYSTEMS II, 2008, 6820
  • [4] Event-centric multi-modal fusion method for dense video captioning
    Chang, Zhi
    Zhao, Dexin
    Chen, Huilin
    Li, Jingdan
    Liu, Pengfei
    [J]. NEURAL NETWORKS, 2022, 146 : 120 - 129
  • [5] Event-Centric Natural Language Processing
    Chen, Muhao
    Zhang, Hongming
    Ning, Qiang
    Li, Manling
    Ji, Heng
    McKeown, Kathleen
    Roth, Dan
    [J]. ACL-IJCNLP 2021: THE 59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING: TUTORIAL ABSTRACTS, 2021, : 6 - 14
  • [6] Event Summarization in Videos
    Aggarwal, Rajat
    Butola, Brijesh Singh
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND AUTOMATION (ICCCA), 2016, : 1150 - 1154
  • [7] Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric Summarization
    Zhao, Zhenjie
    Hou, Yufang
    Wang, Dakuo
    Yu, Mo
    Liu, Chengzhong
    Ma, Xiaojuan
    [J]. PROCEEDINGS OF THE 60TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), VOL 1: (LONG PAPERS), 2022, : 5073 - 5085
  • [8] Event-Centric Microservices for E-states
    Tourgaidis, Dimitrios
    Karakasidis, Alexandros
    [J]. ELECTRONIC GOVERNMENT AND THE INFORMATION SYSTEMS PERSPECTIVE, EGOVIS 2020, 2020, 12394 : 78 - 88
  • [9] An Event-Centric Provenance Model for Digital Libraries
    Castelli, Donatella
    Candela, Leonardo
    Manghi, Paolo
    Pagano, Pasquale
    Tang, Cristina
    Thanos, Costantino
    [J]. DIGITAL LIBRARIES, 2010, 91 : 79 - 88
  • [10] Event-Centric View of Consumer Image Collections
    Hibino, Stacie
    Wood, Mark D.
    [J]. 2009 11TH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2009), 2009, : 207 - 212