3D point cloud super-resolution with dynamic residual graph convolutional networks

被引:0
|
作者
Zhong F. [1 ]
Bai Z.-Y. [1 ]
机构
[1] School of Information Science and Engineering, Yunnan University, Kunming
关键词
3D point cloud; deep learning; dynamic GCN; semantic feature; super-resolution;
D O I
10.3785/j.issn.1008-973X.2022.11.016
中图分类号
学科分类号
摘要
A 3D point cloud super-resolution network with dynamic residual graph convolution (PSR-DRGCN) was proposed to efficiently extract of local information from 3D point clouds of non-European data in super-resolution. The network includes feature extraction module, DRGCN module and upsampling module. For the input point cloud, the feature extraction module locates k nearest points of each point in 3D space by k-NN algorithm and then converts the local geometry information into the high dimensional feature space through a multi-layer pointwise convolution. The DRGCN module converts the local geometry feature of each point into the semantic feature through a multilayer graph convolution. It dynamically adjusts the neighbor space of the point in each layer to increase the receptive field range and effectively fuse the semantic information of different levels through residual connection, which makes the extraction of local geometric information efficient. The upsampling module adds the number of points and maps them from feature space to 3D space. The results showed that at 2× magnification of the high-resolution point cloud generated by PSR-DRGCN, the similarity indexes CD, EMD and F-score compared with the second network were increased by 10.00%, 4.76% and 16.84% respectively. Compared with the second network, the similarity indexes at 6× magnification were increased by 2.35%, 40.00% and 0.58% respectively. In all cases, the optimal effect was achieved on the mean and the std indicators and the generated high-resolution point cloud quality was high. © 2022 Zhejiang University. All rights reserved.
引用
收藏
页码:2251 / 2259
页数:8
相关论文
共 30 条
  • [1] YANG J, WRIGHT J, HUANG T S, Et al., Image super-resolution via sparse representation [J], IEEE Transactions on Image Processing, 19, 11, pp. 2861-2873, (2010)
  • [2] QIAO C, LI D, GUO Y, Et al., Evaluation and development of deep neural networks for image super-resolution in optical microscopy [J], Nature Methods, 18, 2, pp. 194-202, (2021)
  • [3] DUAN Ran, ZHOU Deng-Wen, ZHAO Li-Juan, Et al., Image super-resolution reconstruction based on multi-scale feature mapping network [J], Journal of Zhejiang University: Engineering Science, 53, 7, pp. 1331-1339, (2019)
  • [4] DONG C, LOY C C, HE K, Et al., Image super-resolution using deep convolutional networks [J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2, pp. 295-307, (2015)
  • [5] CHEN Y, LIU L, PHONEVILAY V, Et al., Image super-resolution reconstruction based on feature map attention mechanism [J], Applied Intelligence, 8, pp. 1-14, (2021)
  • [6] WU H, ZHANG J, HUANG K., Point cloud super resolution with adversarial residual graph networks
  • [7] YU L, LI X, FU C W, Et al., Pu-net: point cloud upsampling network [C], Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2790-2799, (2018)
  • [8] LI R, LI X, FU C W, Et al., Pu-gan: a point cloud upsampling adversarial network [C], Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 7203-7212, (2019)
  • [9] QI C R, SU H, MO K, Et al., Pointnet: deep learning on point sets for 3d classification and segmentation [C], Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 652-660, (2017)
  • [10] LI R, LI X, HENG P A, Et al., Point cloud upsampling via Disentangled Refinement [C], Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 344-353, (2021)