A task-driven network for mesh classification and semantic part segmentation

被引:0
|
作者
Dong, Qiujie [1 ]
Gong, Xiaoran [1 ]
Xu, Rui [1 ]
Wang, Zixiong [2 ]
Gao, Junjie [1 ]
Chen, Shuangmin [3 ]
Xin, Shiqing [1 ]
Tu, Changhe [1 ]
Wang, Wenping [4 ]
机构
[1] Shandong Univ, Jinan, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Qingdao Univ Sci & Technol, Qingdao, Peoples R China
[4] Texas A&M Univ, College Stn, TX USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Geometric deep learning; Mesh classification; Semantic part segmentation; Task-driven neural network;
D O I
10.1016/j.cagd.2024.102304
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Given the rapid advancements in geometric deep -learning techniques, there has been a dedicated effort to create mesh -based convolutional operators that act as a link between irregular mesh structures and widely adopted backbone networks. Despite the numerous advantages of Convolutional Neural Networks (CNNs) over Multi -Layer Perceptrons (MLPs), mesh -oriented CNNs often require intricate network architectures to tackle irregularities of a triangular mesh. These architectures not only demand that the mesh be manifold and watertight but also impose constraints on the abundance of training samples. In this paper, we note that for specific tasks such as mesh classification and semantic part segmentation, large-scale shape features play a pivotal role. This is in contrast to the realm of shape correspondence, where a comprehensive understanding of 3D shapes necessitates considering both local and global characteristics. Inspired by this key observation, we introduce a task -driven neural network architecture that seamlessly operates in an end -to -end fashion. Our method takes as input mesh vertices equipped with the heat kernel signature (HKS) and dihedral angles between adjacent faces. Notably, we replace the conventional convolutional module, commonly found in ResNet architectures, with MLPs and incorporate Layer Normalization (LN) to facilitate layer -wise normalization. Our approach, with a seemingly straightforward network architecture, demonstrates an accuracy advantage. It exhibits a marginal 0.1% improvement in the mesh classification task and a substantial 1.8% enhancement in the mesh part segmentation task compared to state-of-the-art methodologies. Moreover, as the number of training samples decreases to 1/50 or even 1/100, the accuracy advantage of our approach becomes more pronounced. In summary, our convolution -free network is tailored for specific tasks relying on large-scale shape features and excels in the situation with a limited number of training samples, setting itself apart from state-of-the-art methodologies.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Task-Driven Progressive Part Localization for Fine-Grained Object Recognition
    Huang, Chen
    He, Zhihai
    Cao, Guitao
    Cao, Wenming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (12) : 2372 - 2383
  • [22] Task-driven neural network models predict neural dynamics of proprioception
    Vargas, Alessandro Marin
    Bisi, Axel
    Chiappa, Alberto S.
    Versteeg, Chris
    Miller, Lee E.
    Mathis, Alexander
    CELL, 2024, 187 (07) : 1745 - 1761.e19
  • [23] Task-Driven Dictionary Learning based on Convolutional Neural Network Features
    Tirer, Tom
    Giryes, Raja
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 1885 - 1889
  • [24] Task-Driven Semantic-Aware Green Cooperative Transmission Strategy for Vehicular Networks
    Yang, Wanting
    Chi, Xuefen
    Zhao, Linlin
    Xiong, Zehui
    Jiang, Wenchao
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (10) : 5783 - 5798
  • [25] TASK-DRIVEN DICTIONARY LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION WITH STRUCTURED SPARSITY PRIORS
    Sun, Xiaoxia
    Nasrabadi, Nasser M.
    Tran, Trac D.
    2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, : 5262 - 5266
  • [26] Graph Neural Networks for Missing Value Classification in a Task-Driven Metric Space
    Huang, Buliao
    Zhu, Yunhui
    Usman, Muhammad
    Zhou, Xiren
    Chen, Huanhuan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) : 8073 - 8084
  • [27] Semisupervised Hyperspectral Classification Using Task-Driven Dictionary Learning With Laplacian Regularization
    Wang, Zhangyang
    Nasrabadi, Nasser M.
    Huang, Thomas S.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (03): : 1161 - 1173
  • [28] Task-Driven Comparison of Topic Models
    Alexander, Eric
    Gleicher, Michael
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2016, 22 (01) : 320 - 329
  • [29] A Task-Driven Adversarial Channel Selection Method for Binary Classification Based on Magnetocardiography
    Ma, Chong
    Pang, Jiaojiao
    Wang, Ruizhe
    Xu, Dong
    Xiang, Min
    Wang, Zhuo
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2025, 72 (03) : 1045 - 1056
  • [30] Task-Driven Dictionary Learning for Hyperspectral Image Classification With Structured Sparsity Constraints
    Sun, Xiaoxia
    Nasrabadi, Nasser M.
    Tran, Trac D.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (08): : 4457 - 4471