Scene-Based Movie Summarization Via Role-Community Networks

被引:46
|
作者
Tsai, Chia-Ming [1 ]
Kang, Li-Wei [2 ,3 ]
Lin, Chia-Wen [4 ,5 ]
Lin, Weisi [6 ]
机构
[1] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Chiayi 62102, Taiwan
[2] Natl Yunlin Univ Sci & Technol, Grad Sch Engn Sci & Technol Doctoral Program, Yunlin 64002, Taiwan
[3] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Yunlin 64002, Taiwan
[4] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
[5] Natl Tsing Hua Univ, Inst Commun Engn, Hsinchu 30013, Taiwan
[6] Nanyang Technol Univ, Div Comp Commun, Sch Comp Engn, Singapore 639798, Singapore
关键词
Movie analysis; movie summarization; social network analysis; video adaptation; video summarization; VIDEO; REPRESENTATION; RECOGNITION; FRAMEWORK;
D O I
10.1109/TCSVT.2013.2269186
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Video summarization techniques aim at condensing a full-length video to a significantly shortened version that still preserves the major semantic content of the original video. Movie summarization, being a special class of video summarization, is particularly challenging since a large variety of movie scenarios and film styles complicate the problem. In this paper, we propose a two-stage scene-based movie summarization method based on mining the relationship between role-communities since the role-communities in earlier scenes are usually used to develop the role relationship in later scenes. In the analysis stage, we construct a social network to characterize the interactions between role-communities. As a result, the social power of each role-community is evaluated by the community's centrality value and the role communities are clustered into relevant groups based on the centrality values. In the summarization stage, a set of feasible summary combinations of scenes is identified and an information-rich summary is selected from these candidates based on social power preservation. Our evaluation results show that in at most test cases the proposed method achieves better subjective performance than attention-based and role-based summarization methods in terms of semantic content preservation for a movie summary.
引用
收藏
页码:1927 / 1940
页数:14
相关论文
共 35 条
  • [1] Learning-Based Movie Summarization via Role-Community Analysis and Feature Fusion
    Li, Jun-Ying
    Kang, Li-Wei
    Tsai, Chia-Ming
    Lin, Chia-Wen
    2015 IEEE 17TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2015,
  • [2] QuickLook: Movie summarization using scene-based leading characters with psychological cues fusion
    Ul Haq, Ijaz
    Muhammad, Khan
    Hussain, Tanveer
    Del Ser, Javier
    Sajjad, Muhammad
    Baik, Sung Wook
    INFORMATION FUSION, 2021, 76 (76) : 24 - 35
  • [3] Scene-based scalable video summarization
    Li, Y
    Kuo, CCJ
    Tretter, D
    INTERNET MULTIMEDIA MANAGEMENT SYSTEMS IV, 2003, 5242 : 34 - 45
  • [4] The role of scene-based versus image-based information in motion correspondence
    Hein, E.
    Moore, C. M.
    PERCEPTION, 2009, 38 : 91 - 91
  • [5] Weather Conditions Using Bayesian Networks: A Scene-Based Approach with CARLA Simulator
    Al-Hindawi, Roza
    Alhadidi, Taqwa
    PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 4, 2024, 1014 : 405 - 415
  • [6] Semantic movie summarization based on string of IE-Role Nets
    Wen Qu
    Yifei Zhang
    Daling Wang
    Shi Feng
    Ge Yu
    ComputationalVisualMedia, 2015, 1 (02) : 129 - 141
  • [7] A Novel Role-Based Movie Scene Segmentation Method
    Liang, Chao
    Zhang, Yifang
    Cheng, Jian
    Xu, Changsheng
    Lu, Hanqing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2009, 2009, 5879 : 917 - 922
  • [8] An Improved Scene-based Nonuniformity Correction Algorithm for Infrared Focal Plane Arrays Using Neural Networks
    隋婧
    金伟其
    董立泉
    王霞
    郭宏
    Journal of China Ordnance, 2006, (02) : 117 - 122
  • [9] Summarization-based Video Caption via Deep Neural Networks
    Li, Guang
    Ma, Shubo
    Han, Yahong
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1191 - 1194
  • [10] Aerial scene understanding in the wild: Multi-scene recognition via prototype-based memory networks
    Hua, Yuansheng
    Mou, Lichao
    Lin, Jianzhe
    Heidler, Konrad
    Zhu, Xiao Xiang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 177 : 89 - 102