Spatial and Semantic Information Enhancement for Indoor 3D Object Detection

被引:0
|
作者
Chen, Chunmei [1 ]
Liang, Zhiqiang [1 ]
Liu, Haitao [1 ]
Liu, Xin [1 ]
机构
[1] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Sichuan, Peoples R China
关键词
3D object detection; edge convolution; attention mechanism; spatial information; semantic information; SCALE;
D O I
10.34028/iajit/20/5/15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Object detection technology is one of the key technologies for indoor service robots. However, due to the various types of objects in the indoor environment, the mutual occlusion between the objects is serious, which increases the difficulty of object detection. In view of the difficult challenges of object detection in the indoor environment, we propose an indoor threedimensional object detection based on deep learning. Most existing 3D object detection techniques based on deep learning lack sufficient spatial and semantic information. To address this issue, the article presents an indoor 3D object detection method with enhanced spatial semantic information. This article proposes a new (Edge Convolution+) EdgeConv+, and based on it, a Shallow Spatial Information Enhancement module (SSIE) is added to Votenet. At the same time, a new attention mechanism, Convolutional Gated Non-Local+ (CGNL+), is designed to add Deep Semantic Information Enhancement module (DSIE) to Votenet. Experiments show that on the ScanNet dataset, the proposed method is 2.4% and 2.1% higher than Votenet at mAP@0.25 and mAP@0.5, respectively. Furthermore, it has strong robustness to deal with sparse point clouds.
引用
收藏
页码:831 / 839
页数:9
相关论文
共 50 条
  • [1] Spatial information enhancement network for 3D object detection from point cloud
    Li, Ziyu
    Yao, Yuncong
    Quan, Zhibin
    Xie, Jin
    Yang, Wankou
    PATTERN RECOGNITION, 2022, 128
  • [2] PointPainting: 3D Object Detection Aided by Semantic Image Information
    Gao, Zhentong
    Wang, Qiantong
    Pan, Zongxu
    Zhai, Zhenyu
    Long, Hui
    SENSORS, 2023, 23 (05)
  • [3] An object detection algorithm combining semantic and geometric information of the 3D cloud
    Huang, Zhe
    Wang, Yongcai
    Wen, Jie
    Wang, Peng
    Cai, Xudong
    ADVANCED ENGINEERING INFORMATICS, 2023, 56
  • [4] EFECL: Feature encoding enhancement with contrastive learning for indoor 3D object detection
    Duan, Yao
    Yi, Renjiao
    Gao, Yuanming
    Xu, Kai
    Zhu, Chenyang
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (04) : 875 - 892
  • [5] EFECL: Feature encoding enhancement with contrastive learning for indoor 3D object detection
    Yao Duan
    Renjiao Yi
    Yuanming Gao
    Kai Xu
    Chenyang Zhu
    Computational Visual Media, 2023, 9 (4) : 875 - 892
  • [6] Semantic Consistency Networks for 3D Object Detection
    Wei, Wenwen
    Wei, Ping
    Zheng, Nanning
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2861 - 2869
  • [7] GFENet: Group-Free Enhancement Network for Indoor Scene 3D Object Detection
    Zhou, Feng
    Dai, Ju
    Pan, Junjun
    Zhu, Mengxiao
    Cai, Xingquan
    Huang, Bin
    Wang, Chen
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT III, 2024, 14497 : 119 - 136
  • [8] Semantic 3D indoor scene enhancement using guide words
    Suiyun Zhang
    Zhizhong Han
    Ralph R. Martin
    Hui Zhang
    The Visual Computer, 2017, 33 : 925 - 935
  • [9] Dual SIE-FPN: Semantic and Spatial Information Enhancement for Multiscale Object Detection
    Liu, Mingjie
    Chen, Junhu
    Liu, Ping
    Chen, Junsheng
    Chang, Kyunghi
    Piao, Changhao
    Li, Minglu
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, : 14164 - 14173
  • [10] Semantic 3D indoor scene enhancement using guide words
    Zhang, Suiyun
    Han, Zhizhong
    Martin, Ralph R.
    Zhang, Hui
    VISUAL COMPUTER, 2017, 33 (6-8): : 925 - 935