Dual-Neighborhood Feature Aggregation Network for Point Cloud Semantic Segmentation

被引:0
|
作者
Chen, Minghong [1 ,2 ]
Zhang, Guanghui [1 ]
Shi, Wenjun [1 ]
Zhu, Dongchen [1 ,2 ]
Zhang, Xiaolin [1 ,3 ,4 ,5 ]
Li, Jiamao [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, State Key Lab Transducer Technol, Bion Vis Syst Lab, Shanghai 200050, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] ShanghaiTech Univ, Sch Informat & Technol, Shanghai 200050, Peoples R China
[4] Xiongan Inst Innovat, Xiongan 071700, Peoples R China
[5] Univ Sci & Technol China, Hefei 230027, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
3D semantic segmentation; dual neighborhood construction; feature enhancement; compound pooling;
D O I
10.1109/ICTAI56018.2022.00020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neighborhood construction plays a key role in point cloud processing. However, existing models only use a single neighborhood construction method to extract neighborhood features, which limits their scene understanding ability. In this paper, we propose a learnable Dual-Neighborhood Feature Aggregation (DNFA) module embedded in the encoder that builds and aggregates comprehensive surrounding knowledge of point clouds. In this module, we first construct two kinds of neighborhoods and design corresponding feature enhancement blocks, including a Basic Local Structure Encoding (BLSE) block and an Extended Context Encoding (ECE) block. The two blocks mine structural and contextual cues for enhancing neighborhood features, respectively. Second, we propose a Geometry-Aware Compound Aggregation (GACA) block, which introduces a functionally complementary compound pooling strategy to aggregate richer neighborhood features. To fully learn the neighborhood distribution, we absorb the geometric location information during the aggregation process. The proposed module is integrated into an MLP-based large-scale 3D processing architecture, which constitutes a 3D semantic segmentation network called DNFA-Net. Extensive experiments on public datasets containing indoor and outdoor scenes validate the superiority of DNFA-Net.
引用
收藏
页码:76 / 81
页数:6
相关论文
共 50 条
  • [1] DUAL-NEIGHBORHOOD DEEP FUSION NETWORK FOR POINT CLOUD ANALYSIS
    Xu, Guoquan
    Cao, Hezhi
    Zhang, Yifan
    Wan, Jianwei
    Xu, Ke
    Ma, Yanxin
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
  • [2] Multi-Scale Neighborhood Feature Extraction and Aggregation for Point Cloud Segmentation
    Li, Dawei
    Shi, Guoliang
    Wu, Yuhao
    Yang, Yanping
    Zhao, Mingbo
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (06) : 2175 - 2191
  • [3] Multi-Feature Aggregation for Semantic Segmentation of an Urban Scene Point Cloud
    Chen, Jiaqing
    Zhao, Yindi
    Meng, Congtang
    Liu, Yang
    [J]. REMOTE SENSING, 2022, 14 (20)
  • [4] Semantic segmentation of point cloud via bilateral feature aggregation and attention mechanism
    Wang, Xibo
    Cao, Shipeng
    Zhao, Huaici
    Liu, Pengfei
    Tai, Bingchang
    [J]. Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2021, 42 (12): : 175 - 183
  • [5] Neighborhood Spatial Aggregation based Efficient Uncertainty Estimation for Point Cloud Semantic Segmentation
    Qi, Chao
    Yin, Jianqin
    Liu, Huaping
    Liu, Jun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 14025 - 14031
  • [6] MFFNet: multimodal feature fusion network for point cloud semantic segmentation
    Ren, Dayong
    Li, Jiawei
    Wu, Zhengyi
    Guo, Jie
    Wei, Mingqiang
    Guo, Yanwen
    [J]. VISUAL COMPUTER, 2024, 40 (08): : 5155 - 5167
  • [7] Sparse point-voxel aggregation network for efficient point cloud semantic segmentation
    Fang, Zheng
    Xiong, Binyu
    Liu, Fei
    [J]. IET COMPUTER VISION, 2022, 16 (07) : 644 - 654
  • [8] FANet: Feature Aggregation Network for Semantic Segmentation
    Singha, Tanmay
    Duc-Son Pham
    Krishna, Aneesh
    [J]. 2020 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2020,
  • [9] DFFAN: Dual Function Feature Aggregation Network for Semantic Segmentation of Land Cover
    Huang, Junqing
    Weng, Liguo
    Chen, Bingyu
    Xia, Min
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (03)
  • [10] High-Performance Feature Extraction Network for Point Cloud Semantic Segmentation
    Liang, Youcheng
    Lu, Jian
    Chen, Xiaogai
    Zhang, Kaibing
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 904 - 908