MHFP: Multi-view based hierarchical fusion pooling method for 3D shape recognition

被引:10
|
作者
Liang, Qi [1 ]
Li, Qiang [1 ]
Zhang, Lihu [2 ]
Mi, Haixiao [3 ]
Nie, Weizhi [2 ]
Li, Xuanya [4 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Tianjin Nav Instrument Res Inst, Tianjin 300131, Peoples R China
[4] Baidu Inc, Beijing 100105, Peoples R China
基金
中国国家自然科学基金;
关键词
Retrieval; Classification; Recognition; Multi-view; 3D attention;
D O I
10.1016/j.patrec.2021.07.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D shape recognition has received widespread attention in the field of computer vision. Since the 3D model contains much geometric information, which is difficult to extract but important to feature learning, effective description of 3D shape is still facing great challenges. With the rapid development of deep learning, a large number of methods have been proposed. However, these approaches always focus on the learning of view features but ignore the multi-view information protection in the process of feature fusion. In this work, we propose a novel Multi-view based Hierarchical Fusion Pooling Method (MHFP) for 3D Model Recognition, which hierarchically fuses the features of multi-view into a compact descriptor. Our approach considers the correlation between views, it can powerfully remove redundant information and retain a large amount of essential information. Meanwhile, we design a 3D attention module to dig out the correlation between the views, which prepares for the graph construction. To verify the effectiveness of our MHFP, we conduct experiments on the ModelNet40 dataset and compare it with some state-of-the-art methods. The final results demonstrate the superiority of our proposed approach in 3D shape recognition. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:214 / 220
页数:7
相关论文
共 50 条
  • [1] Dynamic View Aggregation for Multi-View 3D Shape Recognition
    Zhou, Yuan
    Sun, Zhongqi
    Huo, Shuwei
    Kung, Sun-Yuan
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 9163 - 9174
  • [2] MHSAN: Multi-view hierarchical self-attention network for 3D shape recognition
    Cao, Jiangzhong
    Yu, Lianggeng
    Ling, Bingo Wing-Kuen
    Yao, Zijie
    Dai, Qingyun
    [J]. PATTERN RECOGNITION, 2024, 150
  • [3] MV-LFN: Multi-view based local information fusion network for 3D shape recognition
    Zhang, Jing
    Zhou, Dangdang
    Zhao, Yue
    Nie, Weizhi
    Su, Yuting
    [J]. VISUAL INFORMATICS, 2021, 5 (03) : 114 - 119
  • [4] Multi-view Fusion with Deep Learning for 3D Shape Classification
    Huang, Xiang
    Wang, Mantao
    Zhang, Dejun
    Zhu, Yu
    Zou, Lu
    Sun, Jun
    Han, Fei
    He, Linchao
    [J]. 2018 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), 2018, : 189 - 194
  • [5] MVPN: Multi-View Prototype Network for 3D Shape Recognition
    Wu, Zizhao
    Yang, Ping
    Wang, Yigang
    [J]. IEEE ACCESS, 2019, 7 : 130363 - 130372
  • [6] MVTN: Multi-View Transformation Network for 3D Shape Recognition
    Hamdi, Abdullah
    Giancola, Silvio
    Ghanem, Bernard
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 1 - 11
  • [7] Multi-view Convolutional Neural Networks for 3D Shape Recognition
    Su, Hang
    Maji, Subhransu
    Kalogerakis, Evangelos
    Learned-Miller, Erik
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 945 - 953
  • [8] Multi-view Moments Embedding Network for 3D Shape Recognition
    Xiao, Jun
    Zhang, Yuanxing
    Zhao, Pengyu
    Xiao, Kecheng
    Bian, Kaigui
    Zhang, Chunli
    Yan, Wei
    [J]. PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, : 2257 - 2260
  • [9] 3D Facial Expression Recognition Based on Multi-View and Prior Knowledge Fusion
    Quang Nhat Vo
    Khanh Tran
    Zhao, Guoying
    [J]. 2019 IEEE 21ST INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP 2019), 2019,
  • [10] Multi-View Hierarchical Fusion Network for 3D Object Retrieval and Classification
    Liu, An-An
    Hu, Nian
    Song, Dan
    Guo, Fu-Bin
    Zhou, He-Yu
    Hao, Tong
    [J]. IEEE ACCESS, 2019, 7 : 153021 - 153030