Efficient Nonnegative Tensor Factorization via Saturating Coordinate Descent

被引:9
|
作者
Balasubramaniam, Thirunavukarasu [1 ]
Nayak, Richi [1 ]
Yuen, Chau [2 ]
机构
[1] Queensland Univ Technol, 2 George St, Brisbane, Qld 4000, Australia
[2] Singapore Univ Technol & Design, 8 Somapah Rd, Singapore 487372, Singapore
关键词
Nonnegative tensor factorization; coordinate descent; element selection; saturating coordinate descent; pattern mining; recommender systems; INDIVIDUAL-DIFFERENCES; MATRIX; ALGORITHMS; DECOMPOSITIONS; OPTIMIZATION;
D O I
10.1145/3385654
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advancements in computing technology and web-based applications, data are increasingly generated in multi-dimensional form. These data are usually sparse due to the presence of a large number of users and fewer user interactions. To deal with this, the Nonnegative Tensor Factorization (NTF) based methods have been widely used. However existing factorization algorithms are not suitable to process in all three conditions of size, density, and rank of the tensor. Consequently, their applicability becomes limited. In this article, we propose a novel fast and efficient NTF algorithm using the element selection approach. We calculate the element importance using Lipschitz continuity and propose a saturation point-based element selection method that chooses a set of elements column-wise for updating to solve the optimization problem. Empirical analysis reveals that the proposed algorithm is scalable in terms of tensor size, density, and rank in comparison to the relevant state-of-the-art algorithms.
引用
收藏
页数:28
相关论文
共 50 条
  • [41] NONNEGATIVE TENSOR FACTORIZATION FOR BRAIN CT IMAGE RETRIEVAL
    Liu, Weixiang
    Yuan, Kehong
    Zou, Jiying
    Zhou, Shoujun
    Chen, Wufan
    Jia, Shaowei
    Xiao, Ping
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2008, 4 (11): : 2911 - 2917
  • [42] Fast multiplicative algorithms for symmetric nonnegative tensor factorization
    Wang, Peitao
    He, Zhaoshui
    Yu, Rong
    Tan, Beihai
    Xie, Shengli
    Tan, Ji
    NEUROCOMPUTING, 2022, 500 : 255 - 267
  • [43] Nonnegative Shifted Tensor Factorization in Time Frequency Domain
    Wu, Qiang
    Liu, Ju
    Sun, Fengrong
    Li, Jie
    Cichocki, Andrzej
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 3009 - 3014
  • [44] NONNEGATIVE TENSOR FACTORIZATION FOR SOURCE SEPARATION OF LOOPS IN AUDIO
    Smith, Jordan B. L.
    Goto, Masataka
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 171 - 175
  • [45] Weighted nonnegative tensor factorization for atmospheric tomography reconstruction
    Carmona-Ballester, David
    Trujillo-Sevilla, Juan M.
    Bonaque-Gonzalez, Sergio
    Gomez-Cardenes, Oscar
    Rodriguez-Ramos, Jose M.
    ASTRONOMY & ASTROPHYSICS, 2018, 614
  • [46] NOVEL HIERARCHICAL ALS ALGORITHM FOR NONNEGATIVE TENSOR FACTORIZATION
    Anh Huy Phan
    Cichocki, Andrzej
    Matsuoka, Kiyotoshi
    Cao, Jianting
    2011 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2011, : 1984 - 1987
  • [47] Nonnegative Factorization of Diffusion Tensor Images and Its Applications
    Xie, Yuchen
    Ho, Jeffrey
    Vemuri, Baba C.
    INFORMATION PROCESSING IN MEDICAL IMAGING, 2011, 6801 : 550 - 561
  • [48] Nonnegative Matrix Factorization Using Autoencoders and Exponentiated Gradient Descent
    El Khatib, Alaa
    Huang, Shimeng
    Ghodsi, Ali
    Karray, Fakhri
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [49] Numerical method for the generalized nonnegative tensor factorization problem
    Xue-Feng Duan
    Juan Li
    Shan-Qi Duan
    Qing-Wen Wang
    Numerical Algorithms, 2021, 87 : 499 - 510
  • [50] Sparse Nonnegative Tensor Factorization and Completion With Noisy Observations
    Zhang, Xiongjun
    Ng, Michael K.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (04) : 2551 - 2572