ABDPool: Attention-based Differentiable Pooling

被引:1
|
作者
Liu, Yue [1 ]
Cui, Lixin [1 ]
Wang, Yue [1 ]
Bai, Lu [1 ]
机构
[1] Cent Univ Finance & Econ, 39 South Coll Rd, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICPR56361.2022.9956378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved state-of-the-art performance on a wide range of graph-based tasks such as graph classification and node classification. This is because the unique structure of GNNs allows them to effectively learn embeddings for unstructured data. One important operation for graph classification tasks is downsampling or pooling, which obtains graph representations from node representations. However, most GNNs are associated with global pooling, that can not learn hierarchical graph representations. Meanwhile, current hierarchical pooling methods have the shortcomings of unclear node assignment and uniform aggregation. To overcome these drawbacks, we propose an attention-based differentiable pooling operation in this paper, which can learn a hard cluster assignment for nodes and aggregate nodes in each cluster differently by introducing an attention mechanism. Experiments on standard graph classification benchmarks show that our proposed approach performs better when compared with other competing methods.
引用
收藏
页码:3021 / 3026
页数:6
相关论文
共 50 条
  • [41] Attention-Based DenseNet for Pneumonia Classification
    Wang, K.
    Jiang, P.
    Meng, J.
    Jiang, X.
    IRBM, 2022, 43 (05) : 479 - 485
  • [42] ATT: Attention-based Timbre Transfer
    Jain, Deepak Kumar
    Kumar, Akshi
    Cai, Linqin
    Singhal, Siddharth
    Kumar, Vaibhav
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [43] An attention-based approach to symbol acquisition
    Kozima, H
    Ito, A
    JOINT CONFERENCE ON THE SCIENCE AND TECHNOLOGY OF INTELLIGENT SYSTEMS, 1998, : 852 - 856
  • [44] The Attention-Based View of Great Strategies
    Ocasio, William
    Joseph, John
    STRATEGY SCIENCE, 2018, 3 (01) : 289 - 294
  • [45] Attention-Based Vandalism Detection in OpenStreetMap
    Tempelmeier, Nicolas
    Demidova, Elena
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 643 - 651
  • [46] Attention-based Clinical Note Summarization
    Kanwal, Neel
    Rizzo, Giuseppe
    37TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, 2022, : 813 - 820
  • [47] Attention-Based Neural Text Segmentation
    Badjatiya, Pinkesh
    Kurisinkel, Litton J.
    Gupta, Manish
    Varma, Vasudeva
    ADVANCES IN INFORMATION RETRIEVAL (ECIR 2018), 2018, 10772 : 180 - 193
  • [48] Magnitude Attention-based Dynamic Pruning
    Back, Jihye
    Ahn, Namhyuk
    Kim, Jangho
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 276
  • [49] An Attention-based Architecture for EEG Classification
    Zoppis, Italo
    Zanga, Alessio
    Manzoni, Sara
    Cisotto, Giulia
    Morreale, Angela
    Stella, Fabio
    Mauri, Giancarlo
    PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES, VOL 4: BIOSIGNALS, 2020, : 214 - 219
  • [50] Designing awareness with attention-based groupware
    Vertegaal, R
    HUMAN-COMPUTER INTERACTION - INTERACT '99, 1999, : 245 - 255