ROTATION-EQUIVARIANT GRAPH CONVOLUTIONAL NETWORKS FOR SPHERICAL DATA VIA GLOBAL-LOCAL ATTENTION

被引:1
|
作者
Xu, Jiayi [1 ]
Yang, Qin [1 ]
Li, Chenglin [1 ]
Zou, Junni [1 ]
Xiong, Hongkai [1 ]
Pan, Xinlong [2 ]
Wang, Haipeng [2 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
[2] Naval Aviat Univ, Yantai, Peoples R China
关键词
Spherical images; graph convolutional networks; attention mechanism; classification; semantic segmentation;
D O I
10.1109/ICIP46576.2022.9897510
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph convolutional networks (GCNs) are widely adopted for spherical data processing, striking a balance between rotation equivariance and computation efficiency. However, current GCN-based approaches either apply radial filters with a fixed convolution kernel, or adopt attention schemes to learn a variable kernel based only on node features, which lack expressiveness and may suffer over-smoothing problem. To address this, in this paper, we propose a global-local attention-based spherical graph convolution (GlasGC) for spherical data representation. Specifically, the designed graph convolution includes a structure-enhanced local attention module to estimate the structure correlation efficiently based on topological characteristics of the given spherical graph. The structure correlation is then incorporated with the feature correlation to form the local attention that determines importance of a neighbor node to the center node. We also design a global attention module to obtain the importance scores of different nodes based on both node features and graph topology, which acts as a message-passing enhancer for informative nodes and can relieve the over-smoothing problem. Based on our proposed GlasGC, we design specific GlasGCNs for classification and semantic segmentation of spherical data. Empirical evaluations on these tasks demonstrate that our proposed GlasGCNs can generally achieve better classification and segmentation performance.
引用
收藏
页码:2501 / 2505
页数:5
相关论文
共 50 条
  • [1] Rotation-equivariant graph neural networks for learning glassy liquids representations
    Pezzicoli, Francesco Saverio
    Charpiat, Guillaume
    Landes, Francois Pascal
    [J]. SCIPOST PHYSICS, 2024, 16 (05):
  • [2] Rotation-equivariant spherical vector networks for objects recognition with unknown poses
    Chen, Hao
    Zhao, Jieyu
    Zhang, Qiang
    [J]. VISUAL COMPUTER, 2024, 40 (03): : 2089 - 2101
  • [3] Rotation-equivariant spherical vector networks for objects recognition with unknown poses
    Hao Chen
    Jieyu Zhao
    Qiang Zhang
    [J]. The Visual Computer, 2024, 40 : 2089 - 2101
  • [4] Rotation Equivariant Graph Convolutional Network for Spherical Image Classification
    Yang, Qin
    Li, Chenglin
    Dai, Wenrui
    Zou, Junni
    Qi, Guo-Jun
    Xiong, Hongkai
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4302 - 4311
  • [5] Global-local graph attention: unifying global and local attention for node classification
    Lin, Keao
    Xie, Xiaozhu
    Weng, Wei
    Du, Xiaofeng
    [J]. COMPUTER JOURNAL, 2024, : 2959 - 2969
  • [6] Global-local spatio-temporal graph convolutional networks for video summarization
    Wu, Guangli
    Song, Shanshan
    Zhang, Jing
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2024, 118
  • [7] REAFFPN:ROTATION-EQUIVARIANT ATTENTION FEATURE FUSION PYRAMID NETWORKS FOR AERIAL OBJECT DETETCION
    Sun, Chongyu
    Xu, Yang
    Wu, Zebin
    Wei, Zhihui
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3055 - 3058
  • [8] Multi-Relation Extraction via A Global-Local Graph Convolutional Network
    Cheng, Harry
    Liao, Lizi
    Hu, Linmei
    Nie, Liqiang
    [J]. IEEE TRANSACTIONS ON BIG DATA, 2022, 8 (06) : 1716 - 1728
  • [9] ReAFFPN: Rotation-Equivariant Attention Feature Fusion Pyramid Networks for Aerial Object Detetcion
    Sun, Chongyu
    Xu, Yang
    Wu, Zebin
    Wei, Zhihui
    [J]. International Geoscience and Remote Sensing Symposium (IGARSS), 2022, 2022-July : 3055 - 3058
  • [10] Multi-scale rotation-equivariant graph neural networks for unsteady Eulerian fluid dynamics
    Lino, Mario
    Fotiadis, Stathi
    Bharath, Anil A.
    Cantwell, Chris D.
    [J]. PHYSICS OF FLUIDS, 2022, 34 (08)