Graph manifold learning with non-gradient decision layer

被引:0
|
作者
Jiao, Ziheng [1 ,2 ,3 ]
Zhang, Hongyuan [1 ,2 ,3 ]
Zhang, Rui [2 ,3 ]
Li, Xuelong [2 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian, Peoples R China
[3] Northwestern Polytech Univ, Key Lab Intelligent Interact & Applicat, Minist Ind & Informat Technol, Xian, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Graph convolution network; Manifold learning; Analytical solution; DIMENSIONALITY REDUCTION; NEURAL-NETWORK; CLASSIFICATION; REGRESSION; FRAMEWORK;
D O I
10.1016/j.neucom.2024.127390
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generally, Graph convolution network (GCN) utilizes the graph convolution operators and the softmax to extract the deep representation and make the prediction, respectively. Although GCN successfully represents the connectivity relationship among the nodes by aggregating the information on the graph, the softmax-based decision layer may result in suboptimal performance in semi -supervised learning with less label support due to ignoring the inner distribution of the graph nodes. Besides, the gradient descent will take thousands of interaction for optimization. To address the referred issues, we propose a novel graph deep model with a non -gradient decision layer for graph mining. Firstly, manifold learning is unified with label local -structure preservation to capture the topological information and make accurate predictions with limited label support. Moreover, it is theoretically proven to have analytical solutions and acts as a non -gradient decision layer in graph convolution networks. Particularly, a joint optimization method is designed for this graph model, which extremely accelerates the convergence of the model. Finally, extensive experiments show that the proposed model has achieved excellent performance compared to the current models.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] CLASSIFICATION OF CRITICAL CONDITIONS IN STABILITY THEORY OF NON-GRADIENT SYSTEMS
    MANDADI, V
    HUSEYIN, K
    [J]. MECHANICS RESEARCH COMMUNICATIONS, 1977, 4 (03) : 179 - 183
  • [22] nlstac: Non-Gradient Separable Nonlinear Least Squares Fitting
    Torvisco, J. A. F.
    Benitez, R.
    Arias, M. R.
    Sanchez, J. Cabello
    [J]. R JOURNAL, 2023, 15 (02): : 5 - 24
  • [23] Old and new non-gradient methods in structural engineering optimisation
    Blachut, J
    [J]. OPTIMAIZATION IN INDUSTRY, 2002, : 279 - 288
  • [24] Structure Evolution on Manifold for Graph Learning
    Wan, Hai
    Zhang, Xinwei
    Zhang, Yubo
    Zhao, Xibin
    Ying, Shihui
    Gao, Yue
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7751 - 7763
  • [25] Discretized gradient flow for manifold learning
    Gold, Dara
    Rosenberg, Steven
    [J]. INTERNATIONAL JOURNAL OF MATHEMATICS, 2024, 35 (11)
  • [26] Topology trivialization transition in random non-gradient autonomous ODEs on a sphere
    Fyodorov, Y. V.
    [J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2016,
  • [27] Non-gradient Robust Topology Optimization Method Considering Loading Uncertainty
    Hui Wang
    Wenming Cheng
    Min Zhang
    Run Du
    Wei Xiang
    [J]. Arabian Journal for Science and Engineering, 2021, 46 : 12599 - 12611
  • [28] Geophysical inversions on unstructured meshes using non-gradient based regularization
    Zhang, Yi
    Xu, Yixian
    Yang, Bo
    Mooney, Walter D.
    Wang, Feng
    [J]. GEOPHYSICAL JOURNAL INTERNATIONAL, 2022, 230 (03) : 1864 - 1877
  • [29] Non-gradient and genotype-dependent patterns of RSV gene expression
    Piedra, Felipe-Andres
    Qiu, Xueting
    Teng, Michael N.
    Avadhanula, Vasanthi
    Machado, Annette A.
    Kim, Do-Kyun
    Hixson, James
    Bahl, Justin
    Piedra, Pedro A.
    [J]. PLOS ONE, 2020, 15 (01):
  • [30] A Comparative Study of Gradient Descent Method and a Novel Non-Gradient Method for Structural Shape Optimization
    Jha, Ishan
    Pathak, Krishna K.
    Jha, Mrigank
    Ranjan, Ashutosh
    [J]. INTERNATIONAL JOURNAL OF MATHEMATICAL ENGINEERING AND MANAGEMENT SCIENCES, 2022, 7 (02) : 258 - 271