SCA-Net: Spatial and channel attention-based network for 3D point clouds*

被引:4
|
作者
Tang, Xikai [1 ]
Habashy, Karim [1 ]
Huang, Fangzheng [1 ]
Li, Chao [2 ]
Ban, Dayan [1 ]
机构
[1] Univ Waterloo, Elect & Comp Engn, Waterloo, ON N2L 3G1, Canada
[2] Univ Elect Sci & Technol China, Shenzhen Inst Adv Study, Shenzhen, Peoples R China
基金
加拿大自然科学与工程研究理事会;
关键词
Point clouds; 3D point processing; Attention network; Computer vision;
D O I
10.1016/j.cviu.2023.103690
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A key challenge in data processing of 3D point cloud data is how to identify key regions in the point cloud from geometric relationships. Previous work has attempted to overcome this deficiency by slicing and dicing data. Such an approach limits the model's ability to effectively learn global information. In this paper, in order to better extract features and obtain geometric information we propose a Point Attention (PointAT) model and propose Attention Value (AT value) model for feature fusion to apply geometric relationship to the data. Then, we propose a new Spatial and Channel Attention-based network (SCA). The SCA is the overall structure of the network, and the main purpose is to connect PointAT and AT value model, then capturing meaningful geometric information by applying the geometric relationship between point clouds patches to the model, then propose a auto pooling framework to extract to global features. In this work, we concentrate on learning geometric relationship between point cloud data. For this purpose, we introduce a point attention model based on spatial and channel attention to learn the geometric relationship between point clouds, and further combine the geometric relationship with the point cloud data by the AT Value Model. Finally, we introduce a adaptive downsampling structure, Autopooling. This downsampling structure consider each point's importance weight and picking key points adaptively, which can be used with convolutional networks. Extensive experiments conducted on two benchmark datasets (ModelNet40 and ShapeNet) clearly demonstrate the effectiveness of our SCA and SCA-Auto (SCAA with Auto pooling) methods.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] SCA-Net: A Spatial and Channel Attention Network for Medical Image Segmentation
    Shan, Tong
    Yan, Jiayong
    [J]. IEEE ACCESS, 2021, 9 (09): : 160926 - 160937
  • [2] Hybrid Attention-Based 3D Object Detection with Differential Point Clouds
    Han, Guangjie
    Zhu, Yintian
    Liao, Lyuchao
    Yao, Huiwen
    Zhao, Zhaolin
    Zheng, Qi
    [J]. ELECTRONICS, 2022, 11 (23)
  • [3] DGANet: A Dilated Graph Attention-Based Network for Local Feature Extraction on 3D Point Clouds
    Wan, Jie
    Xie, Zhong
    Xu, Yongyang
    Zeng, Ziyin
    Yuan, Ding
    Qiu, Qinjun
    [J]. REMOTE SENSING, 2021, 13 (17)
  • [4] Attention-Based Joint Semantic-Instance Segmentation of 3D Point Clouds
    Hao, Wen
    Wang, Hongxiao
    Liang, Wei
    Zhao, Minghua
    Xia, Zhaolin
    [J]. ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2022, 22 (02) : 19 - 28
  • [5] Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-Based Sequence to Sequence Network
    Liu, Xinhai
    Han, Zhizhong
    Liu, Yu-Shen
    Zwicker, Matthias
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8778 - 8785
  • [6] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    [J]. PATTERN RECOGNITION, 2020, 107 (107)
  • [7] An attention-based bilateral feature fusion network for 3D point cloud
    Hu, Haibing
    Liu, Hongchun
    Huang, Yecheng
    Li, Chenyang
    Zhu, Jianxiong
    [J]. REVIEW OF SCIENTIFIC INSTRUMENTS, 2024, 95 (06):
  • [8] SCA-Net: A Multiscale Building Segmentation Network Incorporating a Dual-Attention Mechanism
    Yu, Mingyang
    Zhang, Wenzhuo
    Chen, Xiaoxian
    Xu, Haiqing
    Liu, Yaohui
    [J]. IEEE ACCESS, 2022, 10 : 79890 - 79903
  • [9] AttPNet: Attention-Based Deep Neural Network for 3D Point Set Analysis
    Yang, Yufeng
    Ma, Yixiao
    Zhang, Jing
    Gao, Xin
    Xu, Min
    [J]. SENSORS, 2020, 20 (19) : 1 - 20
  • [10] Real-time Hierarchical Soft Attention-based 3D Object Detection in Point Clouds
    Chen, Qiuxiao
    Qi, Xiaojun
    Song, Ziqi
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2928 - 2934