GRAPH-BASED MULTI-MODAL SCENE DETECTION FOR MOVIE AND TELEPLAY

被引:0
|
作者
Xu, Su [1 ]
Feng, Bailan [1 ]
Ding, Peng [1 ]
Xu, Bo [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Digital Content Technol Res Ctr, Beijing 100190, Peoples R China
关键词
graph-modal; multi-modal; STG analysis; audio classify; SEGMENTATION;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Automatic scene detection is a fundamental step for efficient video searching and browsing. This paper presents our current work on scene detection that integrates three effective strategies into a single framework. For each video, firstly, a coherence signal is constructed by graph modal obtained from the similarity matrix in a temporal interval. Secondly, the signal is optimized by scene transition graph (STG) analysis and audio classification, in which scene clues hidden in multimedia are discovered from the video. Finally, the scene boundaries are identified by window function. In experiments, we compare the proposed scene detection method with three typical algorithms on teleplay and movies, and the results of our method, yielding an average 0.85 F-measure, is the best one.
引用
收藏
页码:1413 / 1416
页数:4
相关论文
共 50 条
  • [1] Flexible Multi-modal Graph-Based Segmentation
    Sanberg, Willem P.
    Do, Luat
    de With, Peter H. N.
    [J]. ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2013, 2013, 8192 : 492 - 503
  • [2] Portable graph-based rumour detection against multi-modal heterophily
    Nguyen, Thanh Tam
    Ren, Zhao
    Nguyen, Thanh Toan
    Jo, Jun
    Nguyen, Quoc Viet Hung
    Yin, Hongzhi
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 284
  • [3] GraMuFeN: graph-based multi-modal fake news detection in social media
    Kananian, Makan
    Badiei, Fatemeh
    Gh. Ghahramani, S. AmirAli
    [J]. SOCIAL NETWORK ANALYSIS AND MINING, 2024, 14 (01)
  • [4] Leveraging multi-modal fusion for graph-based image annotation
    Amiri, S. Hamid
    Jamzad, Mansour
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 55 : 816 - 828
  • [5] Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System
    Huang, Jun
    Yang, Yang
    Yu, Hang
    Li, Jianguo
    Zheng, Xiao
    [J]. 2023 38TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, ASE, 2023, : 66 - 78
  • [6] An automated multi-modal graph-based pipeline for mouse genetic discovery
    Fang, Zhuoqing
    Peltz, Gary
    [J]. BIOINFORMATICS, 2022, 38 (13) : 3385 - 3394
  • [7] Audio-Visual Scene Classification Based on Multi-modal Graph Fusion
    Lei, Han
    Chen, Ning
    [J]. INTERSPEECH 2022, 2022, : 4157 - 4161
  • [8] A Graph-Based Approach to Assessing Multi-Modal Team Communication in Global Organizations
    Uflacker, Matthias
    Zeier, Alexander
    [J]. 2008 IEEE SYMPOSIUM ON ADVANCED MANAGEMENT OF INFORMATION FOR GLOBALIZED ENTERPRISES, PROCEEDINGS, 2008, : 307 - 309
  • [9] Multi-modal classification of neurodegenerative disease by progressive graph-based transductive learning
    Wang, Zhengxia
    Zhu, Xiaofeng
    Adeli, Ehsan
    Zhu, Yingying
    Nie, Feiping
    Munsell, Brent
    Wu, Guorong
    [J]. MEDICAL IMAGE ANALYSIS, 2017, 39 : 218 - 230
  • [10] A Novel Graph-based Multi-modal Fusion Encoder for Neural Machine Translation
    Yin, Yongjing
    Meng, Fandong
    Su, Jinsong
    Zhou, Chulun
    Yang, Zhengyuan
    Zhou, Jie
    Luo, Jiebo
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3025 - 3035