ABDPool: Attention-based Differentiable Pooling

被引:1
|
作者
Liu, Yue [1 ]
Cui, Lixin [1 ]
Wang, Yue [1 ]
Bai, Lu [1 ]
机构
[1] Cent Univ Finance & Econ, 39 South Coll Rd, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICPR56361.2022.9956378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved state-of-the-art performance on a wide range of graph-based tasks such as graph classification and node classification. This is because the unique structure of GNNs allows them to effectively learn embeddings for unstructured data. One important operation for graph classification tasks is downsampling or pooling, which obtains graph representations from node representations. However, most GNNs are associated with global pooling, that can not learn hierarchical graph representations. Meanwhile, current hierarchical pooling methods have the shortcomings of unclear node assignment and uniform aggregation. To overcome these drawbacks, we propose an attention-based differentiable pooling operation in this paper, which can learn a hard cluster assignment for nodes and aggregate nodes in each cluster differently by introducing an attention mechanism. Experiments on standard graph classification benchmarks show that our proposed approach performs better when compared with other competing methods.
引用
收藏
页码:3021 / 3026
页数:6
相关论文
共 50 条
  • [1] Neighbour feature attention-based pooling
    Li, Xiaosong
    Wu, Yanxia
    Fu, Yan
    Tang, Chuheng
    Zhang, Lidan
    NEUROCOMPUTING, 2022, 501 : 285 - 293
  • [2] SAGP: A spectral attention-based global pooling
    Yu, Xiang
    Xu, Longzheng
    Han, Yi
    Geng, Zhe
    Zhu, Daiyin
    ELECTRONICS LETTERS, 2024, 60 (11)
  • [3] Multistructure Graph Classification Method With Attention-Based Pooling
    Xu, Yuhua
    Wang, Junli
    Guang, Mingjian
    Yan, Chungang
    Jiang, Changjun
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (02) : 602 - 613
  • [4] Exploring a Unified Attention-Based Pooling Framework for Speaker Verification
    Liu, Yi
    He, Liang
    Liu, Weiwei
    Liu, Jia
    2018 11TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2018, : 200 - 204
  • [5] α-MDF: An Attention-based Multimodal Differentiable Filter for Robot State Estimation
    Liu, Xiao
    Zhou, Yifan
    Ikemoto, Shuhei
    Ben Amor, Heni
    CONFERENCE ON ROBOT LEARNING, VOL 229, 2023, 229
  • [6] A study on attention-based LSTM for abnormal behavior recognition with variable pooling
    Zhou, Kai
    Hui, Bei
    Wang, Junfeng
    Wang, Chunyu
    Wu, Tingting
    IMAGE AND VISION COMPUTING, 2021, 108
  • [7] Ensemble Learning With Attention-Based Multiple Instance Pooling for Classification of SPT
    Zhou, Qinghua
    Zhang, Xin
    Zhang, Yu-Dong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 1927 - 1931
  • [8] Pooling Attention-based Encoder-Decoder Network for semantic segmentation
    Xu, Haixia
    Huang, Yunjia
    Hancock, Edwin R.
    Wang, Shuailong
    Xuan, Qijun
    Zhou, Wei
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 93
  • [9] Blind image quality assessment via learnable attention-based pooling
    Gu, Jie
    Meng, Gaofeng
    Xiang, Shiming
    Pan, Chunhong
    PATTERN RECOGNITION, 2019, 91 : 332 - 344
  • [10] Modelling local and general quantum mechanical properties with attention-based pooling
    Buterez, David
    Janet, Jon Paul
    Kiddle, Steven J.
    Oglic, Dino
    Lio, Pietro
    COMMUNICATIONS CHEMISTRY, 2023, 6 (01)