ABDPool: Attention-based Differentiable Pooling

被引:1
|
作者
Liu, Yue [1 ]
Cui, Lixin [1 ]
Wang, Yue [1 ]
Bai, Lu [1 ]
机构
[1] Cent Univ Finance & Econ, 39 South Coll Rd, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICPR56361.2022.9956378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved state-of-the-art performance on a wide range of graph-based tasks such as graph classification and node classification. This is because the unique structure of GNNs allows them to effectively learn embeddings for unstructured data. One important operation for graph classification tasks is downsampling or pooling, which obtains graph representations from node representations. However, most GNNs are associated with global pooling, that can not learn hierarchical graph representations. Meanwhile, current hierarchical pooling methods have the shortcomings of unclear node assignment and uniform aggregation. To overcome these drawbacks, we propose an attention-based differentiable pooling operation in this paper, which can learn a hard cluster assignment for nodes and aggregate nodes in each cluster differently by introducing an attention mechanism. Experiments on standard graph classification benchmarks show that our proposed approach performs better when compared with other competing methods.
引用
收藏
页码:3021 / 3026
页数:6
相关论文
共 50 条
  • [31] Attention-based texture segregation
    Thomas V. Papathomas
    Andrei Gorea
    Akos Feher
    Tiffany E. Conway
    Perception & Psychophysics, 1999, 61 : 1399 - 1410
  • [32] Refined marine object detector with attention-based spatial pyramid pooling networks and bidirectional feature fusion strategy
    Fengqiang Xu
    Huibing Wang
    Xudong Sun
    Xianping Fu
    Neural Computing and Applications, 2022, 34 : 14881 - 14894
  • [33] Attention-based visual processes
    Cavanagh, P
    INTERNATIONAL JOURNAL OF PSYCHOLOGY, 1996, 31 (3-4) : 3363 - 3363
  • [34] Hybrid pooling and channel attention-based single-shot detector for printed circuit board defect detection
    Feng, Bixian
    Cai, Jueping
    ELECTRONICS LETTERS, 2023, 59 (11)
  • [35] Attention-based quantum tomography
    Cha, Peter
    Ginsparg, Paul
    Wu, Felix
    Carrasquilla, Juan
    McMahon, Peter L.
    Kim, Eun-Ah
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2022, 3 (01):
  • [36] Refined marine object detector with attention-based spatial pyramid pooling networks and bidirectional feature fusion strategy
    Xu, Fengqiang
    Wang, Huibing
    Sun, Xudong
    Fu, Xianping
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17): : 14881 - 14894
  • [37] An Attention-Based Time-Frequency Pyramid Pooling Strategy in Deep Convolutional Networks for Acoustic Scene Classification
    Jiang, Pengxu
    Yang, Yang
    Zou, Cairong
    Wang, Qingyun
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 296 - 300
  • [38] Attention Block Based on Binary Pooling
    Chen, Chang
    Zhang, Huaixiang
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [39] Attention-Based SeriesNet: An Attention-Based Hybrid Neural Network Model for Conditional Time Series Forecasting
    Cheng, Yepeng
    Liu, Zuren
    Morimoto, Yasuhiko
    INFORMATION, 2020, 11 (06)
  • [40] DIFFERENTIABLE POOLING FOR UNSUPERVISED SPEAKER ADAPTATION
    Swietojanski, Pawel
    Renals, Steve
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4305 - 4309