Group k-Sparse Temporal Convolutional Neural Networks: Unsupervised Pretraining for Video Classification

被引：1

作者：

Milacski, Zoltan A. ^{[1
]}

Poczos, Barnabas ^{[2
]}

Lorincz, Andras ^{[1
]}

机构：

[1] Eotvos Lorand Univ, Fac Informat, Budapest, Hungary

[2] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA

来源：

2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2019年

关键词：

group sparsity; temporal; convolutional neural networks; unsupervised learning; video data;

D O I：

10.1109/ijcnn.2019.8852057

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper we propose Group k-Sparse Temporal Convolutional Neural Networks for unsupervised pretraining using video data. Our work is the first to consider the recurrent extension of structured sparsity, thus enhancing representational power and explainability. We show that our architecture is able to outperform several state-of-the-art baselines on Rotated MNIST, Scanned CIFAR-10, COIL-100 and NEC Animal pretraining benchmarks for video classification using limited labeled data.

引用

页数：10

共 50 条

[1] Pretraining Convolutional Neural Networks for Image-Based Vehicle Classification
Han, Yunfei
Jiang, Tonghai
Ma, Yupeng
Xu, Chunxiang
ADVANCES IN MULTIMEDIA, 2018, 2018
[2] Pretraining for Hyperspectral Convolutional Neural Network Classification
Windrim, Lloyd
Melkumyan, Arman
Murphy, Richard J.
Chlingaryan, Anna
Ramakrishnan, Rishi
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05): : 2798 - 2810
[3] Classification of behavior using unsupervised temporal neural networks
Adair, KL
Argo, P
SMC '97 CONFERENCE PROCEEDINGS - 1997 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: CONFERENCE THEME: COMPUTATIONAL CYBERNETICS AND SIMULATION, 1997, : 2584 - 2589
[4] Crowd Video Classification using Convolutional Neural Networks
Burney, Atika
Syed, Tahir Q.
PROCEEDINGS OF 14TH INTERNATIONAL CONFERENCE ON FRONTIERS OF INFORMATION TECHNOLOGY PROCEEDINGS - FIT 2016, 2016, : 247 - 251
[5] Age group classification and gender recognition from speech with temporal convolutional neural networks
Héctor A. Sánchez-Hevia
Roberto Gil-Pita
Manuel Utrilla-Manso
Manuel Rosa-Zurera
Multimedia Tools and Applications, 2022, 81 : 3535 - 3552
[6] Age group classification and gender recognition from speech with temporal convolutional neural networks
Sanchez-Hevia, Hector A.
Gil-Pita, Roberto
Utrilla-Manso, Manuel
Rosa-Zurera, Manuel
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3535 - 3552
[7] Learning Sparse Features in Convolutional Neural Networks for Image Classification
Luo, Wei
Li, Jun
Xu, Wei
Yang, Jian
INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING: IMAGE AND VIDEO DATA ENGINEERING, ISCIDE 2015, PT I, 2015, 9242 : 29 - 38
[8] A Temporal Fusion Approach for Video Classification with Convolutional and LSTM Neural Networks Applied to Violence Detection
de Oliveira Lima, Jean Phelipe
Serodio Figueiredo, Carlos Mauricio
INTELIGENCIA ARTIFICIAL-IBEROAMERICAN JOURNAL OF ARTIFICIAL INTELLIGENCE, 2021, 24 (67): : 40 - 50
[9] Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
Mitsuno, Kakeru
Miyao, Junichi
Kurita, Takio
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[10] Pretraining Convolutional Neural Networks for Mudstone Petrographic Thin-Section Image Classification
de Lima, Rafael Pires
Duarte, David
GEOSCIENCES, 2021, 11 (08)

← 1 2 3 4 5 →