Event Sparse Net: Sparse Dynamic Graph Multi-representation Learning with Temporal Attention for Event-Based Data

被引:0
|
作者
Li, Dan [1 ]
Huang, Teng [1 ]
Hong, Jie [1 ]
Hong, Yile [1 ]
Wang, Jiaqi [1 ]
Wang, Zhen [2 ]
Zhang, Xi [3 ,4 ]
机构
[1] Guangzhou Univ, Inst Artificial Intelligence & Blockchain, Guangzhou, Peoples R China
[2] Zhejiang Lab, Kechuang Ave, Hangzhou, Zhejiang, Peoples R China
[3] Sun Yat Sen Univ, Sch Arts, Guangzhou, Peoples R China
[4] Univ Colorado Boulder, Coll Mus, Boulder, CO 80309 USA
基金
中国国家自然科学基金;
关键词
dynamic graph representations; self-attention mechanism; light sparse temporal model; link prediction;
D O I
10.1007/978-981-99-8546-3_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph structure data has seen widespread utilization in modeling and learning representations, with dynamic graph neural networks being a popular choice. However, existing approaches to dynamic representation learning suffer from either discrete learning, leading to the loss of temporal information, or continuous learning, which entails significant computational burdens. Regarding these issues, we propose an innovative dynamic graph neural network called Event Sparse Net (ESN). By encoding time information adaptively as snapshots and there is an identical amount of temporal structure in each snapshot, our approach achieves continuous and precise time encoding while avoiding potential information loss in snapshot-based methods. Additionally, we introduce a lightweight module, namely Global Temporal Attention, for computing node representations based on temporal dynamics and structural neighborhoods. By simplifying the fully-connected attention fusion, our approach significantly reduces computational costs compared to the currently best-performing methods. We assess our methodology on four continuous/discrete graph datasets for link prediction to assess its effectiveness. In comparison experiments with top-notch baseline models, ESN achieves competitive performance with faster inference speed.
引用
收藏
页码:208 / 219
页数:12
相关论文
共 50 条
  • [1] Sparse-Dyn: Sparse dynamic graph multirepresentation learning via event-based sparse temporal attention network
    Pang, Yan
    Shan, Ai
    Wang, Zhen
    Wang, Mengyu
    Li, Jianwei
    Zhang, Ji
    Huang, Teng
    Liu, Chao
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (11) : 8770 - 8789
  • [2] Event-Based Dynamic Graph Representation Learning for Patent Application Trend Prediction
    Zou, Tao
    Yu, Le
    Sun, Leilei
    Du, Bowen
    Wang, Deqing
    Zhuang, Fuzhen
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (05) : 1951 - 1963
  • [3] Event-Based Dynamic Graph Visualisation
    Simonetto, Paolo
    Archambault, Daniel
    Kobourov, Stephen
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (07) : 2373 - 2386
  • [4] EvAn: Neuromorphic Event-Based Sparse Anomaly Detection
    Annamalai, Lakshmi
    Chakraborty, Anirban
    Thakur, Chetan Singh
    [J]. FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [5] A Theory for Sparse Event-Based Closed Loop Control
    Daye, Pierre
    Ieng, Sio-Hoi
    Benosman, Ryad
    [J]. FRONTIERS IN NEUROSCIENCE, 2019, 13
  • [6] ACOUSTIC SCENE CLASSIFICATION USING SPARSE FEATURE LEARNING AND EVENT-BASED POOLING
    Lee, Kyogu
    Hyung, Ziwon
    Nam, Juhan
    [J]. 2013 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2013,
  • [7] Event-LSTM: An Unsupervised and Asynchronous Learning-Based Representation for Event-Based Data
    Annamalai, Lakshmi
    Ramanathan, Vignesh
    Thakur, Chetan Singh
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 4678 - 4685
  • [8] A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning
    Deng, Yongjian
    Chen, Hao
    Li, Youfu
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1492 - 1500
  • [9] Document-Level Event Argument Extraction with Sparse Representation Attention
    Zhang, Mengxi
    Chen, Honghui
    [J]. MATHEMATICS, 2024, 12 (17)
  • [10] Representation Learning for Event-based Visuomotor Policies
    Vemprala, Sai
    Mian, Sami
    Kapoor, Ashish
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34