Efficient Web Video Classification via Cross-modality Knowledge Transferring

被引:1
|
作者
Xia, Shijun [1 ]
Li, Tianyu [1 ]
Ge, Shengbin [1 ]
Dong, Zhengya [2 ]
机构
[1] State Grid Shanghai Municipal Elect Power Co, Shanghai, Peoples R China
[2] Shineenergy Technol, Shanghai, Peoples R China
关键词
Video Classification; Transfer Learning;
D O I
10.1145/3007669.3007677
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper puts forward a novel method for classifying Web videos with high efficiency. Instead of analyzing the videos or extracting complicated visual features, which are both computationally expensive, we only utilize the related textual information of the to-be-classified Web videos. To address the sparsity of the textual features, we propose to exploit knowledge from auxiliary data of diverse modalilies during training, such that more informative features can be constructed. We carried out extensive experiments on MCG-WEB dataset collected from YouTube for video classification. The results demonstrate that our method can outperform several related state-of-the-art methods markedly and is quite fast, validating its effectiveness and efficiency.
引用
收藏
页码:211 / 216
页数:6
相关论文
共 50 条
  • [41] Cross-modality person re-identification via modality-synergy alignment learning
    Lin, Yuju
    Wang, Banghai
    MACHINE VISION AND APPLICATIONS, 2024, 35 (06)
  • [42] Cross-Modality Binary Code Learning via Fusion Similarity Hashing
    Liu, Hong
    Ji, Rongrong
    Wu, Yongjian
    Huang, Feiyue
    Zhang, Baochang
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6345 - 6353
  • [43] Exploring Cross-Video and Cross-Modality Signals for Weakly-Supervised Audio-Visual Video Parsing
    Lin, Yan-Bo
    Tseng, Hung-Yu
    Lee, Hsin-Ying
    Lin, Yen-Yu
    Yang, Ming-Hsuan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [44] Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation
    Li, Kang
    Yu, Lequan
    Wang, Shujun
    Heng, Pheng-Ann
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 775 - 783
  • [45] Cross-Modality Attention with Semantic Graph Embedding for Multi-Label Classification
    You, Renchun
    Guo, Zhiyao
    Cui, Lei
    Long, Xiang
    Bao, Yingze
    Wen, Shilei
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 12709 - 12716
  • [46] RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering Assisted Distillation
    Zhang, Haiming
    Yan, Xu
    Bai, Dongfeng
    Gao, Jiantao
    Wang, Pan
    Liu, Bingbing
    Cui, Shuguang
    Li, Zhen
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7060 - 7068
  • [47] Enhancing the Accuracy of an Image Classification Model Using Cross-Modality Transfer Learning
    Liu, Jiaqi
    Chui, Kwok Tai
    Lee, Lap-Kei
    ELECTRONICS, 2023, 12 (15)
  • [48] Efficient Shared Feature Learning for Cross-modality Person Re-identification
    Song, Wanru
    Wang, Xinyi
    Liu, Feng
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 100 - 105
  • [49] Targetless Lidar-Camera Calibration via Cross-Modality Structure Consistency
    Ou, Ni
    Cai, Hanyu
    Wang, Junzheng
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2636 - 2648
  • [50] Cross-Modality Person Re-Identification via Modality-Aware Collaborative Ensemble Learning
    Ye, Mang
    Lan, Xiangyuan
    Leng, Qingming
    Shen, Jianbing
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 9387 - 9399