ABDPool: Attention-based Differentiable Pooling

被引:1
|
作者
Liu, Yue [1 ]
Cui, Lixin [1 ]
Wang, Yue [1 ]
Bai, Lu [1 ]
机构
[1] Cent Univ Finance & Econ, 39 South Coll Rd, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICPR56361.2022.9956378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph Neural Networks (GNNs) have achieved state-of-the-art performance on a wide range of graph-based tasks such as graph classification and node classification. This is because the unique structure of GNNs allows them to effectively learn embeddings for unstructured data. One important operation for graph classification tasks is downsampling or pooling, which obtains graph representations from node representations. However, most GNNs are associated with global pooling, that can not learn hierarchical graph representations. Meanwhile, current hierarchical pooling methods have the shortcomings of unclear node assignment and uniform aggregation. To overcome these drawbacks, we propose an attention-based differentiable pooling operation in this paper, which can learn a hard cluster assignment for nodes and aggregate nodes in each cluster differently by introducing an attention mechanism. Experiments on standard graph classification benchmarks show that our proposed approach performs better when compared with other competing methods.
引用
收藏
页码:3021 / 3026
页数:6
相关论文
共 50 条
  • [21] Enhancing breast cancer histopathological image classification using attention-based high order covariance pooling
    Waqas, Muhammad
    Ahmed, Amr
    Maul, Tomas
    Liao, Iman Yi
    Neural Computing and Applications, 2024, 36 (36) : 23275 - 23293
  • [22] Attention-based robot control
    Kasderidis, S
    Taylor, JG
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 2, PROCEEDINGS, 2003, 2774 : 615 - 621
  • [23] Visual Attention-based Watermarking
    Oakes, Matthew
    Bhowmik, Deepayan
    Abhayaratne, Charith
    2011 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2011, : 2653 - 2656
  • [24] Attention-Based Graph Evolution
    Fan, Shuangfei
    Huang, Bert
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 436 - 447
  • [25] An Attention-based Recommendation Algorithm
    Chu, Yan
    Qi, Shuhao
    Yang, Yue
    Shan, Chenqi
    Wang, Lina
    Wang, Zhengkui
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1505 - 1510
  • [26] Attention-based texture segregation
    Papathomas, TV
    Gorea, A
    Feher, A
    Conway, TE
    PERCEPTION & PSYCHOPHYSICS, 1999, 61 (07): : 1399 - 1410
  • [27] Attention-based color correction
    Stentiford, Fred W. M.
    Walker, Matt D.
    HUMAN VISION AND ELECTRONIC IMAGING XI, 2006, 6057
  • [28] Attention-based video streaming
    Dikici, Cagatay
    Bozma, H. Isil
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2010, 25 (10) : 745 - 760
  • [29] Attention-based visual processes
    Cavanagh, P
    CANADIAN PSYCHOLOGY-PSYCHOLOGIE CANADIENNE, 1996, 37 (01): : 59 - 59
  • [30] ATTENTION-BASED MOTION PERCEPTION
    CAVANAGH, P
    SCIENCE, 1992, 257 (5076) : 1563 - 1565