Group k-Sparse Temporal Convolutional Neural Networks: Unsupervised Pretraining for Video Classification

被引：1
|
作者：
Milacski, Zoltan A. [1 ]
Poczos, Barnabas [2 ]
Lorincz, Andras [1 ]
机构：
[1] Eotvos Lorand Univ, Fac Informat, Budapest, Hungary
[2] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
来源：
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2019年
关键词：
group sparsity; temporal; convolutional neural networks; unsupervised learning; video data;
D O I：
10.1109/ijcnn.2019.8852057
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
In this paper we propose Group k-Sparse Temporal Convolutional Neural Networks for unsupervised pretraining using video data. Our work is the first to consider the recurrent extension of structured sparsity, thus enhancing representational power and explainability. We show that our architecture is able to outperform several state-of-the-art baselines on Rotated MNIST, Scanned CIFAR-10, COIL-100 and NEC Animal pretraining benchmarks for video classification using limited labeled data.
引用
收藏
页数：10
相关论文
共 50 条
  • [41] Convolutional Neural Networks Analyzed via Convolutional Sparse Coding
    Papyan, Vardan
    Romano, Yaniv
    Elad, Michael
    JOURNAL OF MACHINE LEARNING RESEARCH, 2017, 18 : 1 - 52
  • [42] An Efficient Accelerator for Sparse Convolutional Neural Networks
    You, Weijie
    Wu, Chang
    2019 IEEE 13TH INTERNATIONAL CONFERENCE ON ASIC (ASICON), 2019,
  • [43] Exploring Sparse Gaussian Processes for Bayesian Optimization in Convolutional Neural Networks for Autism Classification
    Cheekaty, Suresh
    Muneeswari, G.
    IEEE ACCESS, 2024, 12 : 10631 - 10651
  • [44] Feature Extraction and Classification of Cataluminescence Images Based on Sparse Coding Convolutional Neural Networks
    Shi, Guolong
    He, Yigang
    Zhang, Chaolong
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [45] Motor imagery classification using sparse nonnegative matrix factorization and convolutional neural networks
    Chaudhary, Poonam
    Varshney, Yash Vardhan
    Srivastava, Gautam
    Bhatia, Surbhi
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (01): : 213 - 223
  • [46] Motor imagery classification using sparse nonnegative matrix factorization and convolutional neural networks
    Poonam Chaudhary
    Yash Vardhan Varshney
    Gautam Srivastava
    Surbhi Bhatia
    Neural Computing and Applications, 2024, 36 : 213 - 223
  • [47] Human Action Classification Using Temporal Slicing for Deep Convolutional Neural Networks
    Henderson, Nathan
    Aygun, Ramazan
    2017 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM), 2017, : 83 - 90
  • [48] Filter Pruning using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks
    Mitsuno, Kakeru
    Kurita, Takio
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1089 - 1095
  • [49] Review of Convolutional Neural Network in Video Classification
    Talreja, Gaurav
    Mathew, Rejo
    PROCEEDING OF THE INTERNATIONAL CONFERENCE ON COMPUTER NETWORKS, BIG DATA AND IOT (ICCBI-2018), 2020, 31 : 942 - 947
  • [50] RECURRENT CONVOLUTIONAL NEURAL NETWORK FOR VIDEO CLASSIFICATION
    Xu, Zhenqi
    Hu, Jiani
    Deng, Weihong
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
12345