An inexact alternating proximal gradient algorithm for nonnegative CP tensor decomposition

被引:0
|
作者
WANG DeQing [1 ,2 ]
CONG FengYu [1 ,2 ,3 ,4 ]
机构
[1] School of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology
[2] Faculty of Information Technology, University of Jyv?skyl?
[3] School of Artificial Intelligence, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology
[4] Key Laboratory of Integrated Circuit and Biomedical Electronic System, Liaoning Province, Dalian University of Technology
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Nonnegative tensor decomposition has become increasingly important for multiway data analysis in recent years. The alternating proximal gradient(APG) is a popular optimization method for nonnegative tensor decomposition in the block coordinate descent framework. In this study, we propose an inexact version of the APG algorithm for nonnegative CANDECOMP/PARAFAC decomposition, wherein each factor matrix is updated by only finite inner iterations. We also propose a parameter warm-start method that can avoid the frequent parameter resetting of conventional APG methods and improve convergence performance.By experimental tests, we find that when the number of inner iterations is limited to around 10 to 20, the convergence speed is accelerated significantly without losing its low relative error. We evaluate our method on both synthetic and real-world tensors.The results demonstrate that the proposed inexact APG algorithm exhibits outstanding performance on both convergence speed and computational precision compared with existing popular algorithms.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
    Zehui Jia
    Zhongming Wu
    Xiaomei Dong
    [J]. Journal of Inequalities and Applications, 2019
  • [42] Nesterov-Based Alternating Optimization for Nonnegative Tensor Factorization: Algorithm and Parallel Implementation
    Liavas, Athanasios P.
    Kostoulas, Georgios
    Lourakis, Georgios
    Huang, Kejun
    Sidiropoulos, Nicholas D.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2018, 66 (04) : 944 - 953
  • [43] A GENERALIZED HIERARCHICAL NONNEGATIVE TENSOR DECOMPOSITION
    Vendrow, Joshua
    Haddock, Jamie
    Needell, Deanna
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 4473 - 4477
  • [44] Nesterov-based Alternating Optimization for Nonnegative Tensor Completion: Algorithm and Parallel Implementation
    Lourakis, Georgios
    Liavas, Athanasios P.
    [J]. 2018 IEEE 19TH INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING ADVANCES IN WIRELESS COMMUNICATIONS (SPAWC), 2018, : 401 - 405
  • [45] Sparseness Constraints on Nonnegative Tensor Decomposition
    Li, Na
    Navasca, Carmeliza
    [J]. 2010 CONFERENCE RECORD OF THE FORTY FOURTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS (ASILOMAR), 2010, : 613 - 617
  • [46] Fast nonnegative tensor factorization based on accelerated proximal gradient and low-rank approximation
    Zhang, Yu
    Zhou, Guoxu
    Zhao, Qibin
    Cichocki, Andrzej
    Wang, Xingyu
    [J]. NEUROCOMPUTING, 2016, 198 : 148 - 154
  • [47] An inexact proximal generalized alternating direction method of multipliers
    Adona, V. A.
    Goncalves, M. L. N.
    Melo, J. G.
    [J]. COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2020, 76 (03) : 621 - 647
  • [48] A Fast Proximal Gradient Algorithm for Reconstructing Nonnegative Signals with Sparse Transform Coefficients
    Gu, Renliang
    Dogandzic, Aleksandar
    [J]. CONFERENCE RECORD OF THE 2014 FORTY-EIGHTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2014, : 1662 - 1667
  • [49] A Primal-Dual algorithm for nonnegative N-th order CP tensor decomposition: application to fluorescence spectroscopy data analysis
    El Qate, Karima
    El Rhabi, Mohammed
    Hakim, Abdelilah
    Moreau, Eric
    Thirion-Moreau, Nadege
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2022, 33 (02) : 665 - 682
  • [50] A Primal-Dual algorithm for nonnegative N-th order CP tensor decomposition: application to fluorescence spectroscopy data analysis
    Karima EL Qate
    Mohammed El Rhabi
    Abdelilah Hakim
    Eric Moreau
    Nadège Thirion-Moreau
    [J]. Multidimensional Systems and Signal Processing, 2022, 33 : 665 - 682