An inexact alternating proximal gradient algorithm for nonnegative CP tensor decomposition

被引:0
|
作者
WANG DeQing [1 ,2 ]
CONG FengYu [1 ,2 ,3 ,4 ]
机构
[1] School of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology
[2] Faculty of Information Technology, University of Jyv?skyl?
[3] School of Artificial Intelligence, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology
[4] Key Laboratory of Integrated Circuit and Biomedical Electronic System, Liaoning Province, Dalian University of
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Nonnegative tensor decomposition has become increasingly important for multiway data analysis in recent years. The alternating proximal gradient(APG) is a popular optimization method for nonnegative tensor decomposition in the block coordinate descent framework. In this study, we propose an inexact version of the APG algorithm for nonnegative CANDECOMP/PARAFAC decomposition, wherein each factor matrix is updated by only finite inner iterations. We also propose a parameter warm-start method that can avoid the frequent parameter resetting of conventional APG methods and improve convergence performance.By experimental tests, we find that when the number of inner iterations is limited to around 10 to 20, the convergence speed is accelerated significantly without losing its low relative error. We evaluate our method on both synthetic and real-world tensors.The results demonstrate that the proposed inexact APG algorithm exhibits outstanding performance on both convergence speed and computational precision compared with existing popular algorithms.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] An inexact alternating proximal gradient algorithm for nonnegative CP tensor decomposition
    DeQing Wang
    FengYu Cong
    [J]. Science China Technological Sciences, 2021, 64 : 1893 - 1906
  • [2] An inexact alternating proximal gradient algorithm for nonnegative CP tensor decomposition
    Wang, DeQing
    Cong, FengYu
    [J]. SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2021, 64 (09) : 1893 - 1906
  • [3] An inexact alternating proximal gradient algorithm for nonnegative CP tensor decomposition
    WANG DeQing
    CONG FengYu
    [J]. Science China Technological Sciences, 2021, (09) : 1893 - 1906
  • [4] Sparse nonnegative tensor decomposition using proximal algorithm and inexact block coordinate descent scheme
    Deqing Wang
    Zheng Chang
    Fengyu Cong
    [J]. Neural Computing and Applications, 2021, 33 : 17369 - 17387
  • [5] Sparse nonnegative tensor decomposition using proximal algorithm and inexact block coordinate descent scheme
    Wang, Deqing
    Chang, Zheng
    Cong, Fengyu
    [J]. Neural Computing and Applications, 2021, 33 (24) : 17369 - 17387
  • [6] Sparse nonnegative tensor decomposition using proximal algorithm and inexact block coordinate descent scheme
    Wang, Deqing
    Chang, Zheng
    Cong, Fengyu
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (24): : 17369 - 17387
  • [7] Doubly Accelerated Proximal Gradient for Nonnegative Tensor Decomposition
    Wang, Deqing
    [J]. ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 55 - 65
  • [8] Alternating proximal gradient method for sparse nonnegative Tucker decomposition
    Xu, Yangyang
    [J]. MATHEMATICAL PROGRAMMING COMPUTATION, 2015, 7 (01) : 39 - 70
  • [9] A QUADRATICALLY CONVERGENT PROXIMAL ALGORITHM FOR NONNEGATIVE TENSOR DECOMPOSITION
    Vervliet, Nico
    Themelis, Andreas
    Patrinos, Panagiotis
    De Lathauwer, Lieven
    [J]. 28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1020 - 1024
  • [10] Efficient Nonnegative Tensor Decomposition Using Alternating Direction Proximal Method of Multipliers
    Wang, Deqing
    Hu, Guoqiang
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2024, 33 (05) : 1308 - 1316