Tensor Convolutional Dictionary Learning With CP Low-Rank Activations

被引:1
|
作者
Humbert, Pierre [1 ]
Oudre, Laurent [1 ]
Vayatis, Nicolas [1 ]
Audiffren, Julien [2 ]
机构
[1] Univ Paris Saclay, ENS Paris Saclay, CNRS, Ctr Borelli, F-91190 Gif Sur Yvette, France
[2] Univ Fribourg, Cognit & Percept Lab, CH-1700 Fribourg, Switzerland
关键词
Tensors; Convolution; Convolutional codes; Machine learning; Signal processing algorithms; Convergence; Mathematical models; Convolutional dictionary learning; convolutional sparse coding; tensor; canonical polyadic decomposition; LEAST-SQUARES ALGORITHM; THRESHOLDING ALGORITHM; DECOMPOSITION; FACTORIZATION; REGRESSION;
D O I
10.1109/TSP.2021.3135695
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we propose to extend the standard Convolutional Dictionary Learning problem to a tensor representation where the activations are constrained to be "low-rank" through a Canonical Polyadic decomposition. We show that this additional constraint increases the robustness of the CDL with respect to noise and improve the interpretability of the final results. In addition, we discuss in detail the advantages of this representation and introduce two algorithms, based on ADMM or FISTA, that efficiently solve this problem. We show that by exploiting the low rank property of activations, they achieve lower complexity than the main CDL algorithms. Finally, we evaluate our approach on a wide range of experiments, highlighting the modularity and the advantages of this tensorial low-rank formulation.
引用
收藏
页码:785 / 796
页数:12
相关论文
共 50 条
  • [41] Low-Rank Tensor MMSE Equalization
    Ribeiro, Lucas N.
    de Almeida, Andre L. F.
    Mota, Joao C. M.
    [J]. 2019 16TH INTERNATIONAL SYMPOSIUM ON WIRELESS COMMUNICATION SYSTEMS (ISWCS), 2019, : 511 - 516
  • [42] Low-rank group inspired dictionary learning for hyperspectral image classification
    He, Zhi
    Liu, Lin
    Deng, Ruru
    Shen, Yi
    [J]. SIGNAL PROCESSING, 2016, 120 : 209 - 221
  • [43] Multi-view low-rank dictionary learning for image classification
    Wu, Fei
    Jing, Xiao-Yuan
    You, Xinge
    Yue, Dong
    Hu, Ruimin
    Yang, Jing-Yu
    [J]. PATTERN RECOGNITION, 2016, 50 : 143 - 154
  • [44] Robust Image Classification via Low-Rank Double Dictionary Learning
    Rong, Yi
    Xiong, Shengwu
    Gao, Yongsheng
    [J]. MULTIMEDIA MODELING (MMM 2017), PT I, 2017, 10132 : 316 - 328
  • [45] Speech Enhancement Based on Dictionary Learning and Low-Rank Matrix Decomposition
    Ji, Yunyun
    Zhu, Wei-Ping
    Champagne, Benoit
    [J]. IEEE ACCESS, 2019, 7 : 4936 - 4947
  • [46] Sparsity and Low-Rank Dictionary Learning for Sparse Representation of Monogenic Signal
    Dong, Ganggang
    Wang, Na
    Kuang, Gangyao
    Qiu, Hongbing
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (01) : 141 - 153
  • [47] Robust Projective Low-Rank and Sparse Representation by Robust Dictionary Learning
    Ren, Jiahuan
    Zhang, Zhao
    Li, Sheng
    Liu, Guangcan
    Wang, Meng
    Yan, Shuicheng
    [J]. 2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1851 - 1856
  • [48] A MOMENTUM BLOCK-RANDOMIZED STOCHASTIC ALGORITHM FOR LOW-RANK TENSOR CP DECOMPOSITION
    Wang, Qingsong
    Cui, Chunfeng
    Han, Deren
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2021, 17 (03): : 433 - 452
  • [49] Stable Low-Rank CP Decomposition for Compression of Convolutional Neural Networks Based on Sensitivity
    Yang, Chenbin
    Liu, Huiyi
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (04):
  • [50] Low-rank Tensor Learning with Nonconvex Overlapped Nuclear Norm Regularization
    Yao, Quanming
    Wang, Yaqing
    Han, Bo
    Kwok, James T.
    [J]. Journal of Machine Learning Research, 2022, 23