A Second-Order Symmetric Non-Negative Latent Factor Model for Undirected Weighted Network Representation

被引:7
|
作者
Li, Weiling [1 ]
Wang, Renfang [2 ]
Luo, Xin [1 ,3 ]
Zhou, MengChu [4 ,5 ]
机构
[1] Dongguan Univ Technol, Sch Comp Sci & Technol, Dongguan 523808, Peoples R China
[2] Zhejiang Wanli Univ, Coll Big Data & Software Engn, Ningbo 315100, Peoples R China
[3] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
[4] Zhejiang Gongshang Univ, Sch Informat & Elect Engn, Hangzhou 310018, Peoples R China
[5] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Optimization; Computational modeling; Symmetric matrices; Analytical models; Approximation algorithms; Jacobian matrices; Convergence; Conjugate gradient descent; hessian-vector product; latent factor analysis; undirected weighted network; representation learning; symmetric; second-order optimization; MATRIX-FACTORIZATION; OPTIMIZATION; EFFICIENT;
D O I
10.1109/TNSE.2022.3206802
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Precise representation to undirected weighted network (UWN) is the foundation of understanding connection patterns inside a massive node set. It can be addressed via a Symmetric Non-negative Latent Factor (SNLF) model with a non-convex learning objective. However, existing SNLF models commonly adopt a first-order learning algorithm that cannot well handle such a non-convex objective, thereby leading to inaccurate UWN representation. Aiming at addressing this issue, this study incorporates an efficient second-order learning algorithm into an SNLF model, thereby establishing a Second-order Symmetric Non-negative Latent Factor ((SNLF)-N-2) model with two-fold ideas: a) applying the single latent factor-related mapping function to the non-negativity constrained optimization parameters to achieve an unconstrained learning objective, and b) optimizing this learning objective with its optimization parameters through an efficient second-order learning algorithm to achieve accurate representation to the target UWN with affordable computational burden. Empirical studies indicate that owing to its efficient incorporation of the second-order optimization technique, the proposed (SNLF)-N-2 model outperforms state-of-the-art SNLF models when they are used to gain highly accurate representation to UWNs emerging from real applications.
引用
收藏
页码:606 / 618
页数:13
相关论文
共 50 条
  • [31] Smooth, second order, non-negative meshfree approximants selected by maximum entropy
    Cyron, C. J.
    Arroyo, M.
    Ortiz, M.
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2009, 79 (13) : 1605 - 1632
  • [32] A Generalized and Fast-converging Non-negative Latent Factor Model for Predicting User Preferences in Recommender Systems
    Yuan, Ye
    Luo, Xin
    Shang, Mingsheng
    Wu, Di
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 498 - 507
  • [33] Exponential Graph Regularized Non-Negative Low-Rank Factorization for Robust Latent Representation
    Yang, Guowei
    Zhang, Lin
    Wan, Minghua
    MATHEMATICS, 2022, 10 (22)
  • [34] An Improved Non-negative Latent Factor Model via Momentum-Based Additive Gradient Descent Method
    Li, Ming
    Song, Yan
    Wang, Chongjing
    Chu, Yanfang
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 3409 - 3414
  • [35] Joint latent low-rank and non-negative induced sparse representation for face recognition
    Wu, Mingna
    Wang, Shu
    Li, Zhigang
    Zhang, Long
    Wang, Ling
    Ren, Zhenwen
    APPLIED INTELLIGENCE, 2021, 51 (11) : 8349 - 8364
  • [36] Joint latent low-rank and non-negative induced sparse representation for face recognition
    Mingna Wu
    Shu Wang
    Zhigang Li
    Long Zhang
    Ling Wang
    Zhenwen Ren
    Applied Intelligence, 2021, 51 : 8349 - 8364
  • [37] Generating functions, weighted and non-weighted sums for powers of second-order recurrence sequences
    Stanica, P
    FIBONACCI QUARTERLY, 2003, 41 (04): : 321 - 333
  • [38] BAYESIAN NON-NEGATIVE FACTOR ANALYSIS FOR RECONSTRUCTING TRANSCRIPTIONAL REGULATORY NETWORK
    Meng, Jia
    Zhang, Jianqiu
    Chen, Yidong
    Huang, Yufei
    2011 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2011, : 361 - 364
  • [39] A Generalized Nesterov-Accelerated Second-Order Latent Factor Model for High-Dimensional and Incomplete Data
    Li, Weiling
    Wang, Renfang
    Luo, Xin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 15
  • [40] On the properness condition for modal analysis of non-symmetric second-order systems
    Ouisse, Morvan
    Foltete, Emmanuel
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2011, 25 (02) : 601 - 620