Transfer Learning to Timed Text Based Video Classification Using CNN

被引:0
|
作者
Kastrati, Zenun [1 ]
Imran, Ali Shariq [2 ]
Kurti, Arianit [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] Norwegian Univ Sci & Technol, Dept Elect Syst, Trondheim, Norway
来源
PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE, MINING AND SEMANTICS (WIMS 2019) | 2019年
关键词
Video Classification; CNN; DNN; Transfer Learning; Embedding; Machine Learning; MOOC;
D O I
10.1145/3326467.3326483
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Open educational video resources are gaining popularity with a growing number of massive open online courses (MOOCs). This has created a niche for content providers to adopt effective solutions in automatically organizing and structuring of educational resources for maximum visibility. Recent advances in deep learning techniques are proving useful in managing and classifying resources into appropriate categories. This paper proposes one such convolutional neural network (CNN) model for classifying video lectures in a MOOC setting using a transfer learning approach. The model uses a time-aligned text transcripts corresponding to video lectures from six broader subject categories. Video lectures and their corresponding transcript dataset is gathered from the Coursera MOOC platform. Two different CNN models are proposed: i) CNN based classification using embeddings learned from our MOOC dataset, ii) CNN based classification using transfer learning. Word embeddings generated from two well known state-of-the-art pre-trained models Word2Vec and GloVe, are used in the transfer learning approach for the second case. The proposed CNN models are evaluated using precision, recall, and F1 score and the obtained performance is compared with both conventional and deep learning classifiers. The proposed CNN models have an F1 score improvement of 10-22 percentage points over DNN and conventional classifiers.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Learning CNN architecture for multi-view text classification using genetic algorithms
    Sargisson, Finn
    Gao, Xiaoying
    Xue, Bing
    2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 1507 - 1514
  • [32] SEA ICE AND OPEN WATER CLASSIFICATION OF SAR IMAGERY USING CNN-BASED TRANSFER LEARNING
    Xu, Yan
    Scott, K. Andrea
    2017 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2017, : 3262 - 3265
  • [33] COMPARATIVE ANALYSIS OF PERFORMANCE OF DEEP CNN BASED FRAMEWORK FOR BRAIN MRI CLASSIFICATION USING TRANSFER LEARNING
    Kulkarni, Sunita M.
    Sundari, G.
    JOURNAL OF ENGINEERING SCIENCE AND TECHNOLOGY, 2021, 16 (04): : 2901 - 2917
  • [34] Turkish Text Classification with Machine Learning and Transfer Learning
    Aydogan, Murat
    Karci, Ali
    2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA PROCESSING (IDAP 2019), 2019,
  • [35] Brain tumor classification using deep CNN features via transfer learning
    Deepak, S.
    Ameer, P. M.
    COMPUTERS IN BIOLOGY AND MEDICINE, 2019, 111
  • [36] Classification of Shells and Pebbles Using CNN with MobileNetV2 Transfer Learning
    Singh, Rahul
    Sharma, Neha
    Upadhyay, Deepak
    Devliyal, Swati
    Pal, Abhishek
    2024 2ND WORLD CONFERENCE ON COMMUNICATION & COMPUTING, WCONF 2024, 2024,
  • [37] Human Carrying Baggage Classification Using Transfer Learning on CNN with Direction Attribute
    Wahyono
    Jo, Kang-Hyun
    INTELLIGENT COMPUTING THEORIES AND APPLICATION, ICIC 2017, PT I, 2017, 10361 : 717 - 724
  • [38] Automatic Classification of Vulnerabilities Based on CNN and Text Semantics
    Qu L.-Y.
    Jia Y.-Z.
    Hao Y.-L.
    Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 (07): : 738 - 742
  • [39] Hyperspectral Classification Based on Lightweight 3-D-CNN With Transfer Learning
    Zhang, Haokui
    Li, Ying
    Jiang, Yenan
    Wang, Peng
    Shen, Qiang
    Shen, Chunhua
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08): : 5813 - 5828
  • [40] A CNN-Based Transfer Learning Method for Defect Classification in Semiconductor Manufacturing
    Imoto, Kazunori
    Nakai, Tomohiro
    Ike, Tsukasa
    Haruki, Kosuke
    Sato, Yoshiyuki
    IEEE TRANSACTIONS ON SEMICONDUCTOR MANUFACTURING, 2019, 32 (04) : 455 - 459