View-GCN: View-based Graph Convolutional Network for 3D Shape Analysis

被引:225
|
作者
Wei, Xin [1 ]
Yu, Ruixuan [1 ]
Sun, Jian [1 ]
机构
[1] Xi An Jiao Tong Univ, Xian 710049, Peoples R China
关键词
NEURAL-NETWORK;
D O I
10.1109/CVPR42600.2020.00192
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
View-based approach that recognizes 3D shape through its projected 2D images has achieved state-of-the-art results for 3D shape recognition. The major challenge for view-based approach is how to aggregate multi-view features to be a global shape descriptor. In this work, we propose a novel view-based Graph Convolutional Neural Network, dubbed as view-GCN, to recognize 3D shape based on graph representation of multiple views in flexible view configurations. We first construct view-graph with multiple views as graph nodes, then design a graph convolutional neural network over view-graph to hierarchically learn discriminative shape descriptor considering relations of multiple views. The view-GCN is a hierarchical network based on local and non-local graph convolution for feature transform, and selective view-sampling for graph coarsening. Extensive experiments on benchmark datasets show that view-GCN achieves state-of-the-art results for 3D shape classification and retrieval.
引用
收藏
页码:1847 / 1856
页数:10
相关论文
共 50 条
  • [1] Learning View-Based Graph Convolutional Network for Multi-View 3D Shape Analysis
    Wei, Xin
    Yu, Ruixuan
    Sun, Jian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (06) : 7525 - 7541
  • [2] Pairwise View Weighted Graph Network for View-based 3D Model Retrieval
    Gao, Zan
    Li, Yin-ming
    Guan, Wei-li
    Nie, Wei-zhi
    Cheng, Zhi-yong
    Liu, An-an
    PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, : 129 - 138
  • [3] A Novel Patch Convolutional Neural Network for View-based 3D Model Retrieval
    Gao, Zan
    Shao, Yuxiang
    Guan, Weili
    Liu, Meng
    Cheng, Zhiyong
    Chen, Shengyong
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 2699 - 2707
  • [4] A view-based 3D object shape representation technique
    Ebrahim, Yasser
    Ahmed, Maher
    Chau, Siu-Cheung
    Abdelsalam, Wegdan
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2007, 4633 : 411 - +
  • [5] View-based weight network for 3D object recognition
    Huang, Qiang
    Wang, Yongxiong
    Yin, Zhong
    IMAGE AND VISION COMPUTING, 2020, 93 (93)
  • [6] View-based 3D model retrieval with probabilistic graph model
    Gao, Yue
    Tang, Jinhui
    Li, Haojie
    Dai, Qionghai
    Zhang, Naiyao
    NEUROCOMPUTING, 2010, 73 (10-12) : 1900 - 1905
  • [7] Enhanced 3D shape retrieval using view-based silhouette representation
    Wen, Liuying
    Tan, Guoxin
    2008 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING, VOLS 1 AND 2, PROCEEDINGS, 2008, : 928 - 931
  • [8] Enhanced 3D shape retrieval using view-based silhouette representation
    Wen Liuying
    Tan Guoxin
    ADVANCING SCIENCE THROUGH COMPUTATION, 2008, : 4 - 7
  • [9] Multi-Level View Associative Convolution Network for View-Based 3D Model Retrieval
    Gao, Zan
    Zhang, Yan
    Zhang, Hua
    Guan, Weili
    Feng, Dong
    Chen, Shengyong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) : 2264 - 2278
  • [10] View-Based 3D Model Retrieval via Multi-graph Matching
    Weizhi Nie
    Anan Liu
    Yahui Hao
    Yuting Su
    Neural Processing Letters, 2018, 48 : 1395 - 1404