A Second-Order Symmetric Non-Negative Latent Factor Model for Undirected Weighted Network Representation

被引:7
|
作者
Li, Weiling [1 ]
Wang, Renfang [2 ]
Luo, Xin [1 ,3 ]
Zhou, MengChu [4 ,5 ]
机构
[1] Dongguan Univ Technol, Sch Comp Sci & Technol, Dongguan 523808, Peoples R China
[2] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[3] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
[4] Zhejiang Gongshang Univ, Sch Informat & Elect Engn, Hangzhou 310018, Peoples R China
[5] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Optimization; Computational modeling; Symmetric matrices; Analytical models; Approximation algorithms; Jacobian matrices; Convergence; Conjugate gradient descent; hessian-vector product; latent factor analysis; undirected weighted network; representation learning; symmetric; second-order optimization; MATRIX-FACTORIZATION; OPTIMIZATION; EFFICIENT;
D O I
10.1109/TNSE.2022.3206802
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Precise representation to undirected weighted network (UWN) is the foundation of understanding connection patterns inside a massive node set. It can be addressed via a Symmetric Non-negative Latent Factor (SNLF) model with a non-convex learning objective. However, existing SNLF models commonly adopt a first-order learning algorithm that cannot well handle such a non-convex objective, thereby leading to inaccurate UWN representation. Aiming at addressing this issue, this study incorporates an efficient second-order learning algorithm into an SNLF model, thereby establishing a Second-order Symmetric Non-negative Latent Factor ((SNLF)-N-2) model with two-fold ideas: a) applying the single latent factor-related mapping function to the non-negativity constrained optimization parameters to achieve an unconstrained learning objective, and b) optimizing this learning objective with its optimization parameters through an efficient second-order learning algorithm to achieve accurate representation to the target UWN with affordable computational burden. Empirical studies indicate that owing to its efficient incorporation of the second-order optimization technique, the proposed (SNLF)-N-2 model outperforms state-of-the-art SNLF models when they are used to gain highly accurate representation to UWNs emerging from real applications.
引用
收藏
页码:606 / 618
页数:13
相关论文
共 50 条
  • [1] Symmetric Non-negative Latent Factor Models for Undirected Large Networks
    Luo, Xin
    Shang, Ming-Sheng
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2435 - 2442
  • [2] Relaxed Symmetric Non-negative Latent Factor Analysis for Large-scale Undirected Weighted Networks
    Zhong, Yurong
    Luo, Xin
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 3050 - 3055
  • [3] A Truncated Newton Method-Based Symmetric Non-negative Latent Factor Model for Large-scale Undirected Networks Representation
    Li, Weiling
    Luo, Xin
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1699 - 1704
  • [4] Assimilating Second-Order Information for Building Non-Negative Latent Factor Analysis-Based Recommenders
    Li, Weiling
    He, Qiang
    Luo, Xin
    Wang, Zidong
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (01): : 485 - 497
  • [5] Momentum-Incorporated Symmetric Non-Negative Latent Factor Models
    Zhong, Yurong
    Jin, Long
    Shang, Mingsheng
    Luo, Xin
    IEEE TRANSACTIONS ON BIG DATA, 2020, 8 (04) : 1096 - 1106
  • [6] Convergence Analysis of a Fast Non-negative Latent Factor Model
    Zhou, Yue
    Liu, Zhigang
    Yu, Xiaojiang
    Wu, Yajuan
    2019 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2019, : 2291 - 2297
  • [7] A Distributed Adaptive Second-Order Latent Factor Analysis Model
    Jialiang Wang
    Weiling Li
    Xin Luo
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (11) : 2343 - 2345
  • [8] An Adaptive Divergence-Based Non-Negative Latent Factor Model
    Yuan, Ye
    Wang, Renfang
    Yuan, Guangxiao
    Xin, Luo
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (10): : 6475 - 6487
  • [9] Non-Negative Latent Factor Model Based on β-Divergence for Recommender Systems
    Xin, Luo
    Yuan, Ye
    Zhou, MengChu
    Liu, Zhigang
    Shang, Mingsheng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (08): : 4612 - 4623
  • [10] An Adaptive PID-Incorporated Non-Negative Latent Factor Analysis Model
    Li, Jinli
    Zhou, ChengXuan
    Yuan, Ye
    2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, : 424 - 428