Spectral Graph Learning With Core Eigenvectors Prior via Iterative GLASSO and Projection

被引:0
|
作者
Bagheri, Saghar [1 ]
Do, Tam Thuc [1 ]
Cheung, Gene [1 ]
Ortega, Antonio [2 ]
机构
[1] York Univ, Dept Elect Engn & Comp Sci, Toronto, ON M3J 1P3, Canada
[2] Univ Southern Calif, Dept Elect Comp Engn, Los Angeles, CA 90089 USA
基金
加拿大自然科学与工程研究理事会;
关键词
Laplace equations; Symmetric matrices; Signal processing algorithms; Covariance matrices; Eigenvalues and eigenfunctions; Optimization; Reviews; Graph signal processing; graph learning; convex optimization;
D O I
10.1109/TSP.2024.3446453
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Before the execution of many standard graph signal processing (GSP) modules, such as compression and restoration, learning of a graph that encodes pairwise (dis)similarities in data is an important precursor. In data-starved scenarios, to reduce parameterization, previous graph learning algorithms make assumptions in the nodal domain on i) graph connectivity (e.g., edge sparsity), and/or ii) edge weights (e.g., positive edges only). In this paper, given an empirical covariance matrix (C) over bar estimated from sparse data, we consider instead a spectral-domain assumption on the graph Laplacian matrix L: the first K eigenvectors (called"core" eigenvectors){u(k)}of L are pre-selected-e.g., based on domain-specific knowledge-and only the remaining eigen vectors are learned and parameterized. We first prove that, inside a Hilbert space of real symmetric matrices, the subspace H+u of positive semi-definite (PSD) matrices sharing a common set of core K eigenvectors {u(k)} is a convex cone. Inspired by the Gram-Schmidt procedure, we then construct an efficient operator to project a given positive definite (PD) matrix on to H-u(+). Finally, we design a hybrid graphical lasso/projection algorithm to compute a locally optimal inverse Laplacian L-1 is an element of H-u(+) given (C) over bar. We apply our graph learning algorithm in two practical settings: parliamentary voting interpolation and predictive transform coding in image compression. Experiments show that our algorithm outperformed existing graph learning schemes in data-starved scenarios for both synthetic data and these two settings
引用
收藏
页码:3958 / 3972
页数:15
相关论文
共 33 条
  • [1] LEARNING SPARSE GRAPH LAPLACIAN WITH K EIGENVECTOR PRIOR VIA ITERATIVE GLASSO AND PROJECTION
    Bagheri, Saghar
    Cheung, Gene
    Ortega, Antonio
    Wang, Fen
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 5365 - 5369
  • [2] Efficient Heterogeneous Graph Learning via Random Projection
    Hu, Jun
    Hooi, Bryan
    He, Bingsheng
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8093 - 8107
  • [3] Low-Rank Projection Learning via Graph Embedding
    Liang, Yingyi
    You, Lei
    Lu, Xiaohuan
    He, Zhenyu
    Wang, Hongpeng
    NEUROCOMPUTING, 2019, 348 : 97 - 106
  • [4] Scalable Graph Topology Learning via Spectral Densification
    Wang, Yongyu
    Zhao, Zhiqiang
    Feng, Zhuo
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 1099 - 1108
  • [5] Structured Graph Learning via Laplacian Spectral Constraints
    Kumar, Sandeep
    Ying, Jiaxi
    Cardoso, Jos Vinicius de M.
    Palomar, Daniel P.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [6] Augmenting Affective Dependency Graph via Iterative Incongruity Graph Learning for Sarcasm Detection
    Wang, Xiaobao
    Dong, Yiqi
    Jin, Di
    Li, Yawen
    Wang, Longbiao
    Dang, Jianwu
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 4, 2023, : 4702 - 4710
  • [7] Shape prior model via dual subspace segment projection learning
    Belous, Gregg
    Busch, Andrew
    Gao, Yongsheng
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 200 (200)
  • [8] Iterative Reconstruction Via Prior Image Constrained Total Generalized Variation for Spectral CT
    Niu, S.
    Zhang, Y.
    Ma, J.
    Wang, J.
    MEDICAL PHYSICS, 2016, 43 (06) : 3835 - 3835
  • [9] A unified framework for structured graph learning via spectral constraints
    Kumar, Sandeep
    Ying, Jiaxi
    Cardoso, José Vinícius de M.
    Palomar, Daniel P.
    Journal of Machine Learning Research, 2020, 21
  • [10] A Unified Framework for Structured Graph Learning via Spectral Constraints
    Kumar, Sandeep
    Ying, Jiaxi
    Cardoso, Jose Vincius de M.
    Palomar, Daniel P.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21