FULLY-CONNECTED TENSOR NETWORK DECOMPOSITION FOR ROBUST TENSOR COMPLETION PROBLEM

被引:9
|
作者
Liu, Yun-Yang [1 ]
Zhao, Xi-Le [1 ]
Song, Guang-Jing [2 ]
Zheng, Yu-Bang [3 ]
Ng, Michael K. [4 ]
Huang, Ting-Zhu [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Math Sci, Chengdu 611731, Peoples R China
[2] Weifang Univ, Sch Math & Informat Sci, Weifang 261061, Peoples R China
[3] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[4] Univ Hong Kong, Dept Math, Hong Kong 999077, Peoples R China
基金
中国国家自然科学基金;
关键词
Robust tensor completion; fully-connected tensor network decompo-sition; exact recovery guarantee; RANK MINIMIZATION; FACTORIZATION; OPTIMIZATION;
D O I
10.3934/ipi.2023030
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
. Motivated by the success of fully-connected tensor network (FCTN) decomposition, we suggest two FCTN-based models for the robust tensor completion (RTC) problem. Firstly, we propose an FCTN-based robust nonconvex optimization model (RNC-FCTN) directly based on FCTN decomposition for the RTC problem. Then, a proximal alternating minimization (PAM)-based algorithm is developed to solve the proposed RNC-FCTN. Meanwhile, we theoretically derive the convergence of the PAM-based algorithm. Although the nonconvex model has shown empirically excellent results, the exact recovery guarantee is still missing and N(N -1)/2 + 1 tuning parameters are difficult to choose for N-th order tensor. Therefore, we propose the FCTN nuclear norm as the convex surrogate function of the FCTN rank and suggest an FCTN nuclear norm-based robust convex optimization model (RC-FCTN) for the RTC problem. For solving the constrained optimization model RC-FCTN, we develop an alternating direction method of multipliers (ADMM)-based algorithm, which enjoys the global convergence guarantee. To explore the exact recovery guarantee, we design a constructive singular value decomposition (SVD)-based FCTN decomposition, which is another crucial algorithm to obtain the factor tensors of FCTN decomposition. Accordingly, we rigorously establish the exact recovery guarantee for the RC-FCTN and suggest the theoretical optimal value for the only one parameter in the convex model. Comprehensive numerical experiments in several applications, such as video completion and video background subtraction, demonstrate that the suggested convex and nonconvex models have achieved state-of-the-art performance.
引用
收藏
页码:208 / 238
页数:31
相关论文
共 50 条
  • [41] Brain Image Completion by Bayesian Tensor Decomposition
    Gui, Lihua
    Zhao, Qibin
    Cao, Jianting
    2017 22ND INTERNATIONAL CONFERENCE ON DIGITAL SIGNAL PROCESSING (DSP), 2017,
  • [42] Canonical Tensor Decomposition for Knowledge Base Completion
    Lacroix, Timothee
    Usunier, Nicolas
    Obozinski, Guillaume
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [43] Tensor Completion Network for Visual Data
    Wang, Xiang-Yu
    Li, Xiao-Peng
    Sidiropoulos, Nicholas D.
    So, Hing Cheung
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2025, 73 : 386 - 400
  • [44] Bayesian tensor network structure search and its application to tensor completion
    Zeng, Junhua
    Zhou, Guoxu
    Qiu, Yuning
    Li, Chao
    Zhao, Qibin
    NEURAL NETWORKS, 2024, 175
  • [45] Fourier PCA and Robust Tensor Decomposition
    Goyal, Navin
    Vempala, Santosh
    Xiao, Ying
    STOC'14: PROCEEDINGS OF THE 46TH ANNUAL 2014 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2014, : 584 - 593
  • [46] Robust Tensor Decomposition with Gross Corruption
    Gu, Quanquan
    Gui, Huan
    Han, Jiawei
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 27 (NIPS 2014), 2014, 27
  • [47] Robust Image Hashing with Tensor Decomposition
    Tang, Zhenjun
    Chen, Lv
    Zhang, Xianquan
    Zhang, Shichao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2019, 31 (03) : 549 - 560
  • [48] Tensor Ring Decomposition with Rank Minimization on Latent Space: An Efficient Approach for Tensor Completion
    Yuan, Longhao
    Li, Chao
    Mandic, Danilo
    Cao, Jianting
    Zhao, Qibin
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9151 - 9158
  • [49] An Effective Tensor Completion Method Based on Multi-linear Tensor Ring Decomposition
    Yu, Jinshi
    Zhou, Guoxu
    Zhao, Qibin
    Xie, Kan
    2018 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2018, : 1344 - 1349
  • [50] Multilayer Sparsity-Based Tensor Decomposition for Low-Rank Tensor Completion
    Xue, Jize
    Zhao, Yongqiang
    Huang, Shaoguang
    Liao, Wenzhi
    Chan, Jonathan Cheung-Wai
    Kong, Seong G.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6916 - 6930