Exponential family tensor factorization: an online extension and applications

被引:6
|
作者
Hayashi, Kohei [1 ]
Takenouchi, Takashi [1 ]
Shibata, Tomohiro [1 ]
Kamiya, Yuki [2 ]
Kato, Daishi [2 ]
Kunieda, Kazuo [2 ]
Yamada, Keiji [2 ]
Ikeda, Kazushi [1 ]
机构
[1] Nara Inst Sci & Technol, Grad Sch Informat Sci, Nara, Japan
[2] NEC Corp Ltd, C&C Innovat Res Labs, Minato Ku, Tokyo, Japan
关键词
Bayesian probabilistic model; Tensor factorization; Online learning; Data fusion; Multi-sensor analysis; Anomaly detection; DECOMPOSITIONS;
D O I
10.1007/s10115-012-0517-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new probabilistic model of heterogeneously attributed multi-dimensional arrays. The model can manage heterogeneity by employing individual exponential family distributions for each attribute of the tensor array. Entries of the tensor are connected by latent variables and share information across the different attributes through the latent variables. The assumption of heterogeneity makes a Bayesian inference intractable, and we cast the EM algorithm approximated by the Laplace method and Gaussian process. We also extended the proposal algorithm for online learning. We apply our method to missing-values prediction and anomaly detection problems and show that our method outperforms conventional approaches that do not consider heterogeneity.
引用
收藏
页码:57 / 88
页数:32
相关论文
共 50 条
  • [1] Exponential family tensor factorization: an online extension and applications
    Kohei Hayashi
    Takashi Takenouchi
    Tomohiro Shibata
    Yuki Kamiya
    Daishi Kato
    Kazuo Kunieda
    Keiji Yamada
    Kazushi Ikeda
    [J]. Knowledge and Information Systems, 2012, 33 : 57 - 88
  • [2] Dynamic Exponential Family Matrix Factorization
    Hayashi, Kohei
    Hirayama, Jun-ichiro
    Ishii, Shin
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2009, 5476 : 452 - +
  • [3] Accurate Online Tensor Factorization for Temporal Tensor Streams with Missing Values
    Ahn, Dawon
    Kim, Seyun
    Kang, U.
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2822 - 2826
  • [4] MULTILAYER TENSOR FACTORIZATION WITH APPLICATIONS TO RECOMMENDER SYSTEMS
    Bi, Xuan
    Qu, Annie
    Shen, Xiaotong
    [J]. ANNALS OF STATISTICS, 2018, 46 (6B): : 3308 - 3333
  • [5] Exponential family tensor completion with auxiliary information
    Yang, Jichen
    Zhang, Nan
    [J]. STAT, 2020, 9 (01):
  • [6] Regularized online tensor factorization for sparse knowledge graph embeddings
    Zulaika, Unai
    Almeida, Aitor
    Lopez-de-Ipina, Diego
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (01): : 787 - 797
  • [7] Regularized online tensor factorization for sparse knowledge graph embeddings
    Unai Zulaika
    Aitor Almeida
    Diego López-de-Ipiña
    [J]. Neural Computing and Applications, 2023, 35 : 787 - 797
  • [8] Extension of the variance function of a steep exponential family
    Hassairi, A
    Masmoudi, A
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2005, 92 (02) : 239 - 256
  • [9] Joint Tensor Factorization and Outlying Slab Suppression With Applications
    Fu, Xiao
    Huang, Kejun
    Ma, Wing-Kin
    Sidiropoulos, Nicholas D.
    Bro, Rasmus
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (23) : 6315 - 6328
  • [10] AN ORDER-p TENSOR FACTORIZATION WITH APPLICATIONS IN IMAGING
    Martin, Carla D.
    Shafer, Richard
    Larue, Betsy
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2013, 35 (01): : A474 - A490