A DCA-based sparse coding for video summarization with MCP

被引:0
|
作者
Li, Yujie [1 ]
Li, Zhenni [2 ,3 ]
Tan, Benying [1 ]
Ding, Shuxue [1 ]
机构
[1] Guilin Univ Elect Technol, Guangxi Coll & Univ Key Lab AI Algorithm Engn, Sch Artificial Intelligence, Jinji Rd, Guilin, Peoples R China
[2] Guangdong Univ Technol, Sch Automat, Guangdong Key Lab IoT Informat Technol, Guangzhou, Peoples R China
[3] Guangdong Univ Technol, Sch Automat, Guangdong Key Lab IoT Informat Technol, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
computer vision; image processing; image segmentation; signal processing; sparse matrices; video signal processing; VISUAL-ATTENTION; MINIMIZATION; EXTRACTION; FRAMEWORK; MODEL;
D O I
10.1049/ipr2.12738
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video summarization offers a summary version that conveys the primary information of a longer video. The main challenges of video summarization are related to keyframe extraction and saliency mapping. Thus, this work proposes a sparse coding model for keyframe extraction and saliency mapping applications. Specifically, the minimax concave penalty (MCP) is utilized as a sparse regularization scheme and the regularized non-convex MCP problem is solved by decomposing MCP into two convex functions and the convex function's algorithm difference is relied on to solve the resulting sub-problems. The experimental results demonstrate higher compressed keyframes and saliency maps than current state-of-the-art algorithms. In particular, the model attains a lower summary length of 34% and 19% compared to sparse modeling representation selection (SMRS) and sparse modeling using the determinant sparsity measure (SC-det), respectively. In addition, the developed scheme has a shorter computation time, requiring 82% and 33% less time than the ITTI and the dense and sparse reconstruction (DSR) methods.
引用
收藏
页码:1564 / 1577
页数:14
相关论文
共 50 条
  • [21] Forward-Backward Nonlinear Sparse Dictionary Selection based Video Summarization
    Ma, Mingyang
    Mei, Shaohui
    Wan, Shuai
    Wang, Zhiyong
    Feng, David Dagan
    2018 IEEE FOURTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM), 2018,
  • [22] Video summarization using sparse representation of local descriptors
    Jenabzadeh, Roya
    Behrad, Alireza
    INTELLIGENT DECISION TECHNOLOGIES-NETHERLANDS, 2019, 13 (03): : 315 - 327
  • [23] NONLINEAR KERNEL SPARSE DICTIONARY SELECTION FOR VIDEO SUMMARIZATION
    Ma, Mingyang
    Mei, Shaohui
    Hou, Junhui
    Wan, Shuai
    Wang, Zhiyong
    Feng, Dagan
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 637 - 642
  • [24] Video Summarization via Simultaneous Block Sparse Representation
    Ma, Mingyang
    Mei, Shaohui
    Wan, Shuai
    Hou, Junhui
    Wang, Zhiyong
    Feng, Dagan
    2017 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING - TECHNIQUES AND APPLICATIONS (DICTA), 2017, : 676 - 682
  • [25] SPARSE UNSUPERVISED CLUSTERING WITH MIXTURE OBSERVATIONS FOR VIDEO SUMMARIZATION
    Xiang, Xiang
    Tran, Dung N.
    Tran, Trac D.
    2017 IEEE APPLIED IMAGERY PATTERN RECOGNITION WORKSHOP (AIPR), 2017,
  • [26] Video summarization via block sparse dictionary selection
    Ma, Mingyang
    Mei, Shaohui
    Wan, Shuai
    Hou, Junhui
    Wang, Zhiyong
    Feng, David Dagan
    NEUROCOMPUTING, 2020, 378 : 197 - 209
  • [27] Error Bound and Isocost Imply Linear Convergence of DCA-Based Algorithms to D-Stationarity
    Min Tao
    Jiang-Ning Li
    Journal of Optimization Theory and Applications, 2023, 197 : 205 - 232
  • [28] SPARSE MODELING FOR TOPIC-ORIENTED VIDEO SUMMARIZATION
    Panda, Rameswar
    Roy-Chowdhury, Amit K.
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1388 - 1392
  • [29] Video Summarization via Nonlinear Sparse Dictionary Selection
    Ma, Mingyang
    Mei, Shaohui
    Wan, Shuai
    Wang, Zhiyong
    Feng, Dagan
    IEEE ACCESS, 2019, 7 : 11763 - 11774
  • [30] VIOLENT VIDEO DETECTION BASED ON MoSIFT FEATURE AND SPARSE CODING
    Xu, Long
    Gong, Chen
    Yang, Jie
    Wu, Qiang
    Yao, Lixiu
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,