A comprehensive survey of multi-view video summarization

被引:81
|
作者
Hussain, Tanveer [1 ]
Muhammad, Khan [2 ]
Ding, Weiping [3 ]
Lloret, Jaime [4 ]
Baik, Sung Wook [1 ]
de Albuquerque, Victor Hugo C. [5 ]
机构
[1] Sejong Univ, Digital Contents Res Inst, Intelligent Media Lab, Seoul 143747, South Korea
[2] Sungkyunkwan Univ, Sch Convergence, Coll Comp & Informat, Visual Analyt Knowledge Lab VIS2KNOW Lab, Seoul 03063, South Korea
[3] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
[4] Univ Politecn Valencia, Valencia, Spain
[5] Univ Fortaleza, Lab Bioinformat, Fortaleza, Ceara, Brazil
基金
新加坡国家研究基金会;
关键词
Computer vision; Multi-view video summarization; Multi-sensor management; Multi-camera networks; Machine learning; Features fusion; Big data; Video summarization survey; CONVOLUTIONAL NEURAL-NETWORK; SYNOPSIS; IMAGES; CLOUD; EDGE;
D O I
10.1016/j.patcog.2020.107567
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been an exponential growth in the amount of visual data on a daily basis acquired from single or multi-view surveillance camera networks. This massive amount of data requires efficient mechanisms such as video summarization to ensure that only significant data are reported and the redundancy is reduced. Multi-view video summarization (MVS) is a less redundant and more concise way of providing information from the video content of all the cameras in the form of either keyframes or video segments. This paper presents an overview of the existing strategies proposed for MVS, including their advantages and drawbacks. Our survey covers the genericsteps in MVS, such as the pre-processing of video data, feature extraction, and post-processing followed by summary generation. We also describe the datasets that are available for the evaluation of MVS. Finally, we examine the major current issues related to MVS and put forward the recommendations for future research(1). (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multi-view Video Summarization
    Thingom, Chintureena
    Yeon, Guydeuk
    [J]. INFORMATION SYSTEMS DESIGN AND INTELLIGENT APPLICATIONS, VOL 3, INDIA 2016, 2016, 435 : 461 - 473
  • [2] Multi-View Video Summarization
    Fu, Yanwei
    Guo, Yanwen
    Zhu, Yanshu
    Liu, Feng
    Song, Chuanming
    Zhou, Zhi-Hua
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2010, 12 (07) : 717 - 729
  • [3] MULTI-VIEW METRIC LEARNING FOR MULTI-VIEW VIDEO SUMMARIZATION
    Wang, Linbo
    Fang, Xianyong
    Guo, Yanwen
    Fu, Yanwei
    [J]. 2016 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2016, : 179 - 182
  • [4] Multi-view Video Summarization Algorithm for WMSN
    Zhang, Mei-yan
    Cai, Wen-yu
    [J]. 2014 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATION AND SENSOR NETWORK (WCSN), 2014, : 213 - 216
  • [5] Video Summarization in a Multi-View Camera Network
    Panda, Rameswar
    Das, Abir
    Roy-Chowdhury, Amit K.
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2971 - 2976
  • [6] Video Summarization via Multi-View Representative Selection
    Meng, Jingjing
    Wang, Suchen
    Wang, Hongxing
    Yuan, Junsong
    Tan, Yap-Peng
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 1189 - 1198
  • [7] A Comprehensive Survey on Multi-View Clustering
    Fang, Uno
    Li, Man
    Li, Jianxin
    Gao, Longxiang
    Jia, Tao
    Zhang, Yanchun
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12350 - 12368
  • [8] Video Clip Growth: A General Algorithm for Multi-view Video Summarization
    Pan, Gang
    Qu, Xingming
    Lv, Liangfu
    Guo, Shuai
    Sun, Di
    [J]. ADVANCES IN MULTIMEDIA INFORMATION PROCESSING, PT III, 2018, 11166 : 112 - 122
  • [9] On-Line Multi-View Video Summarization for Wireless Video Sensor Network
    Ou, Shun-Hsing
    Lee, Chia-Han
    Somayazulu, V. Srinivasa
    Chen, Yen-Kuang
    Chien, Shao-Yi
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2015, 9 (01) : 165 - 179
  • [10] Multi-View Surveillance Video Summarization via Joint Embedding and Sparse Optimization
    Panda, Rameswar
    Roy-Chowdhury, Amit K.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (09) : 2010 - 2021