A task-driven network for mesh classification and semantic part segmentation

被引:0
|
作者
Dong, Qiujie [1 ]
Gong, Xiaoran [1 ]
Xu, Rui [1 ]
Wang, Zixiong [2 ]
Gao, Junjie [1 ]
Chen, Shuangmin [3 ]
Xin, Shiqing [1 ]
Tu, Changhe [1 ]
Wang, Wenping [4 ]
机构
[1] Shandong Univ, Jinan, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Qingdao Univ Sci & Technol, Qingdao, Peoples R China
[4] Texas A&M Univ, College Stn, TX USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Geometric deep learning; Mesh classification; Semantic part segmentation; Task-driven neural network;
D O I
10.1016/j.cagd.2024.102304
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Given the rapid advancements in geometric deep -learning techniques, there has been a dedicated effort to create mesh -based convolutional operators that act as a link between irregular mesh structures and widely adopted backbone networks. Despite the numerous advantages of Convolutional Neural Networks (CNNs) over Multi -Layer Perceptrons (MLPs), mesh -oriented CNNs often require intricate network architectures to tackle irregularities of a triangular mesh. These architectures not only demand that the mesh be manifold and watertight but also impose constraints on the abundance of training samples. In this paper, we note that for specific tasks such as mesh classification and semantic part segmentation, large-scale shape features play a pivotal role. This is in contrast to the realm of shape correspondence, where a comprehensive understanding of 3D shapes necessitates considering both local and global characteristics. Inspired by this key observation, we introduce a task -driven neural network architecture that seamlessly operates in an end -to -end fashion. Our method takes as input mesh vertices equipped with the heat kernel signature (HKS) and dihedral angles between adjacent faces. Notably, we replace the conventional convolutional module, commonly found in ResNet architectures, with MLPs and incorporate Layer Normalization (LN) to facilitate layer -wise normalization. Our approach, with a seemingly straightforward network architecture, demonstrates an accuracy advantage. It exhibits a marginal 0.1% improvement in the mesh classification task and a substantial 1.8% enhancement in the mesh part segmentation task compared to state-of-the-art methodologies. Moreover, as the number of training samples decreases to 1/50 or even 1/100, the accuracy advantage of our approach becomes more pronounced. In summary, our convolution -free network is tailored for specific tasks relying on large-scale shape features and excels in the situation with a limited number of training samples, setting itself apart from state-of-the-art methodologies.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Meta Learning for Task-Driven Video Summarization
    Li, Xuelong
    Li, Hongli
    Dong, Yongsheng
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (07) : 5778 - 5786
  • [42] Guided model creation: A task-driven approach
    Lahtinen, Samuel
    Peltonen, Jari
    Hammouda, Imed
    Koskimies, Kai
    IEEE SYMPOSIUM ON VISUAL LANGUAGES AND HUMAN-CENTRIC COMPUTING, PROCEEDINGS, 2006, : 89 - +
  • [43] Quantization in task-driven sensing and distributed processing
    Gray, Robert M.
    2006 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-13, 2006, : 5907 - 5910
  • [44] Task-driven camera operations for robotic exploration
    Hughes, SB
    Lewis, M
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2005, 35 (04): : 513 - 522
  • [45] A Task-Driven Feedback Imager with Uncertainty Driven Hybrid Control
    Mudassar, Burhan A.
    Saha, Priyabrata
    Wolf, Marilyn
    Mukhopadhyay, Saibal
    SENSORS, 2021, 21 (08)
  • [46] Task-Driven Prompt Evolution for Foundation Models
    Sathish, Rachana
    Venkataramani, Rahul
    Shriram, K. S.
    Sudhakar, Prasad
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS, 2023, 14393 : 256 - 264
  • [47] Selfish Task-Driven Routing in Hybrid Networks
    Li, Yupeng
    Tan, Haisheng
    Wang, Yongcai
    Han, Zhenhua
    Lau, Francis C. M.
    2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt), 2015, : 387 - 394
  • [48] Task-Driven Composition of Web User Interfaces
    Betermieux, Stefan
    Bomsdorf, Birgit
    COMPUTER-AIDED DESIGN OF USER INTERFACES VI, 2009, : 233 - +
  • [49] Task-Driven Variability Model for Speaker Verification
    Chen Chen
    Jiqing Han
    Circuits, Systems, and Signal Processing, 2020, 39 : 3125 - 3144
  • [50] Task-driven control of robots integrated in IMS
    Borangiu, Theodor
    Manu, Mitica
    Annual Reviews in Control, 1998, 22 : 99 - 109