Group k-Sparse Temporal Convolutional Neural Networks: Unsupervised Pretraining for Video Classification

被引：1

作者：

Milacski, Zoltan A. ^{[1
]}

Poczos, Barnabas ^{[2
]}

Lorincz, Andras ^{[1
]}

机构：

[1] Eotvos Lorand Univ, Fac Informat, Budapest, Hungary

[2] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA

来源：

2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2019年

关键词：

group sparsity; temporal; convolutional neural networks; unsupervised learning; video data;

D O I：

10.1109/ijcnn.2019.8852057

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper we propose Group k-Sparse Temporal Convolutional Neural Networks for unsupervised pretraining using video data. Our work is the first to consider the recurrent extension of structured sparsity, thus enhancing representational power and explainability. We show that our architecture is able to outperform several state-of-the-art baselines on Rotated MNIST, Scanned CIFAR-10, COIL-100 and NEC Animal pretraining benchmarks for video classification using limited labeled data.

引用

页数：10

共 50 条

[21] SRGC-Nets: Sparse Repeated Group Convolutional Neural Networks
Lu, Yao
Lu, Guangming
Lin, Rui
Li, Jinxing
Zhang, David
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (08) : 2889 - 2902
[22] TOWARDS ROBUST VISUAL TRANSFORMER NETWORKS VIA K-SPARSE ATTENTION
Amini, Sajjad
Ghaemmaghami, Shahrokh
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4053 - 4057
[23] Complex-valued unsupervised convolutional neural networks for sleep stage classification
Zhang, Junming
Wu, Yan
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 164 : 181 - 191
[24] Super Sparse Convolutional Neural Networks
Lu, Yao
Lu, Guangming
Zhang, Bob
Xu, Yuanrong
Li, Jinxing
THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 4440 - 4447
[25] Sparse Convolutional Neural Networks for particle classification in ProtoDUNE-SP events
Abud, Adam Abed
20TH INTERNATIONAL WORKSHOP ON ADVANCED COMPUTING AND ANALYSIS TECHNIQUES IN PHYSICS RESEARCH, 2023, 2438
[26] Classification by Sparse Neural Networks
Kurkova, Vera
Sanguineti, Marcello
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (09) : 2746 - 2754
[27] k-Sparse Autoencoder-Based Automatic Modulation Classification With Low Complexity
Afan Ali
Fan Yangyu
IEEE COMMUNICATIONS LETTERS, 2017, 21 (10) : 2162 - 2165
[28] Structured Sparsity of Convolutional Neural Networks via Nonconvex Sparse Group Regularization
Bui, Kevin
Park, Fredrick
Zhang, Shuai
Qi, Yingyong
Xin, Jack
FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS, 2021, 6
[29] UNSUPERVISED CONVOLUTIONAL NEURAL NETWORKS FOR MOTION ESTIMATION
Ahmadi, Aria
Patras, Ioannis
2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1629 - 1633
[30] Pansharpening via Unsupervised Convolutional Neural Networks
Luo, Shuyue
Zhou, Shangbo
Feng, Yong
Xie, Jiangan
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 4295 - 4310

← 1 2 3 4 5 →