UNSUPERVISED FEATURE EXTRACTION FOR MULTIMEDIA EVENT DETECTION AND RANKING USING AUDIO CONTENT

被引:0
|
作者
Amid, Ehsan [1 ,2 ]
Mesaros, Annamaria [1 ]
Palomaki, Kalle J. [1 ]
Laaksonen, Jorma [2 ]
Kurimo, Mikko [1 ]
机构
[1] Aalto Univ, Dept Signal Proc & Acoust, Espoo 02150, Finland
[2] Aalto Univ, Dept Informat & Comp Sci, Espoo 02150, Finland
基金
芬兰科学院;
关键词
Multimedia Event Detection; Unsupervised Feature Extraction; Stacked Denoising Autoencoders; Bag of Words; Term Weighting; Weighted Jensen-Shannon Divergence;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In this paper, we propose a new approach to classify and rank multimedia events based purely on audio content using video data from TRECVID-2013 multimedia event detection (MED) challenge. We perform several layers of nonlinear mappings to extract a set of unsupervised features from an initial set of temporal and spectral features to obtain a superior presentation of the atomic audio units. Additionally, we propose a novel weighted divergence measure for kernel based classifiers. The extensive set of experiments confirms that augmentation of the proposed steps results in an improved accuracy for most of the event classes.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Consumer-level multimedia event detection through unsupervised audio signal modeling
    Byun, Byungki
    Kim, Ilseo
    Siniscalchi, Sabato Marco
    Lee, Chin-Hui
    [J]. 13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3, 2012, : 2079 - 2082
  • [2] An Overview of Audio Event Detection Methods from Feature Extraction to Classification
    Babaee, Elham
    Anuar, Nor Badrul
    Wahab, Ainuddin Wahid Abdul
    Shamshirband, Shahaboddin
    Chronopoulos, Anthony T.
    [J]. APPLIED ARTIFICIAL INTELLIGENCE, 2017, 31 (9-10) : 661 - 714
  • [3] Audio based event detection for multimedia surveillance
    Atrey, Pradeep K.
    Maddage, Namunu C.
    Kankanhalli, Mohan S.
    [J]. 2006 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-13, 2006, : 5671 - 5674
  • [4] Improving event detection in cricket videos using audio feature analysis
    Premaratne, S.C.
    Gamanayake, A.
    Jayaratne, K.L.
    Sellappan, P.
    [J]. International Journal of Circuits, Systems and Signal Processing, 2021, 15 : 434 - 438
  • [5] Feature Extraction and Detection of Planetary Gear Box Fault Using Unsupervised Feature Learning
    Li, Dongdong
    Wang, Hao
    Yang, Fan
    Zheng, Xiaoxia
    Hua, Wei
    Zou, Shenghua
    [J]. Dianwang Jishu/Power System Technology, 2018, 42 (11): : 3805 - 3811
  • [6] Detection of Epileptic Seizures using Unsupervised Learning Techniques for Feature Extraction
    Tautan, Alexandra-Maria
    Dogariu, Mihai
    Ionescu, Bogdan
    [J]. 2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 2377 - 2381
  • [7] Audio content based feature extraction on subband domain
    Shieh, JRJ
    [J]. 37TH ANNUAL 2003 INTERNATIONAL CARNAHAN CONFERENCE ON SECURITY TECHNOLOGY, PROCEEDINGS, 2003, : 552 - 555
  • [8] AUDIO-BASED MULTIMEDIA EVENT DETECTION USING DEEP RECURRENT NEURAL NETWORKS
    Wang, Yun
    Neves, Leonardo
    Metze, Florian
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 2742 - 2746
  • [9] Multimedia Event Detection Using Segment-Based Approach for Motion Feature
    Sang Phan
    Thanh Duc Ngo
    Vu Lam
    Son Tran
    Duy-Dinh Le
    Duc Anh Duong
    Satoh, Shin'ichi
    [J]. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2014, 74 (01): : 19 - 31
  • [10] Multimedia Event Detection Using Segment-Based Approach for Motion Feature
    Sang Phan
    Thanh Duc Ngo
    Vu Lam
    Son Tran
    Duy-Dinh Le
    Duc Anh Duong
    Shin’ichi Satoh
    [J]. Journal of Signal Processing Systems, 2014, 74 : 19 - 31