Scene-Based Movie Summarization Via Role-Community Networks

被引:46
|
作者
Tsai, Chia-Ming [1 ]
Kang, Li-Wei [2 ,3 ]
Lin, Chia-Wen [4 ,5 ]
Lin, Weisi [6 ]
机构
[1] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Chiayi 62102, Taiwan
[2] Natl Yunlin Univ Sci & Technol, Grad Sch Engn Sci & Technol Doctoral Program, Yunlin 64002, Taiwan
[3] Natl Yunlin Univ Sci & Technol, Dept Comp Sci & Informat Engn, Yunlin 64002, Taiwan
[4] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
[5] Natl Tsing Hua Univ, Inst Commun Engn, Hsinchu 30013, Taiwan
[6] Nanyang Technol Univ, Div Comp Commun, Sch Comp Engn, Singapore 639798, Singapore
关键词
Movie analysis; movie summarization; social network analysis; video adaptation; video summarization; VIDEO; REPRESENTATION; RECOGNITION; FRAMEWORK;
D O I
10.1109/TCSVT.2013.2269186
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Video summarization techniques aim at condensing a full-length video to a significantly shortened version that still preserves the major semantic content of the original video. Movie summarization, being a special class of video summarization, is particularly challenging since a large variety of movie scenarios and film styles complicate the problem. In this paper, we propose a two-stage scene-based movie summarization method based on mining the relationship between role-communities since the role-communities in earlier scenes are usually used to develop the role relationship in later scenes. In the analysis stage, we construct a social network to characterize the interactions between role-communities. As a result, the social power of each role-community is evaluated by the community's centrality value and the role communities are clustered into relevant groups based on the centrality values. In the summarization stage, a set of feasible summary combinations of scenes is identified and an information-rich summary is selected from these candidates based on social power preservation. Our evaluation results show that in at most test cases the proposed method achieves better subjective performance than attention-based and role-based summarization methods in terms of semantic content preservation for a movie summary.
引用
收藏
页码:1927 / 1940
页数:14
相关论文
共 35 条