A task-driven network for mesh classification and semantic part segmentation

被引:0
|
作者
Dong, Qiujie [1 ]
Gong, Xiaoran [1 ]
Xu, Rui [1 ]
Wang, Zixiong [2 ]
Gao, Junjie [1 ]
Chen, Shuangmin [3 ]
Xin, Shiqing [1 ]
Tu, Changhe [1 ]
Wang, Wenping [4 ]
机构
[1] Shandong Univ, Jinan, Peoples R China
[2] Nankai Univ, Tianjin, Peoples R China
[3] Qingdao Univ Sci & Technol, Qingdao, Peoples R China
[4] Texas A&M Univ, College Stn, TX USA
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Geometric deep learning; Mesh classification; Semantic part segmentation; Task-driven neural network;
D O I
10.1016/j.cagd.2024.102304
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Given the rapid advancements in geometric deep -learning techniques, there has been a dedicated effort to create mesh -based convolutional operators that act as a link between irregular mesh structures and widely adopted backbone networks. Despite the numerous advantages of Convolutional Neural Networks (CNNs) over Multi -Layer Perceptrons (MLPs), mesh -oriented CNNs often require intricate network architectures to tackle irregularities of a triangular mesh. These architectures not only demand that the mesh be manifold and watertight but also impose constraints on the abundance of training samples. In this paper, we note that for specific tasks such as mesh classification and semantic part segmentation, large-scale shape features play a pivotal role. This is in contrast to the realm of shape correspondence, where a comprehensive understanding of 3D shapes necessitates considering both local and global characteristics. Inspired by this key observation, we introduce a task -driven neural network architecture that seamlessly operates in an end -to -end fashion. Our method takes as input mesh vertices equipped with the heat kernel signature (HKS) and dihedral angles between adjacent faces. Notably, we replace the conventional convolutional module, commonly found in ResNet architectures, with MLPs and incorporate Layer Normalization (LN) to facilitate layer -wise normalization. Our approach, with a seemingly straightforward network architecture, demonstrates an accuracy advantage. It exhibits a marginal 0.1% improvement in the mesh classification task and a substantial 1.8% enhancement in the mesh part segmentation task compared to state-of-the-art methodologies. Moreover, as the number of training samples decreases to 1/50 or even 1/100, the accuracy advantage of our approach becomes more pronounced. In summary, our convolution -free network is tailored for specific tasks relying on large-scale shape features and excels in the situation with a limited number of training samples, setting itself apart from state-of-the-art methodologies.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Task-Driven Dictionary Learning Based on Mutual Information for Medical Image Classification
    Diamant, Idit
    Klang, Eyal
    Amitai, Michal
    Konen, Eli
    Goldberger, Jacob
    Greenspan, Hayit
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (06) : 1380 - 1392
  • [32] TASK-DRIVEN DICTIONARY LEARNING WITH DIFFERENT LAPLACIAN PRIORS FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Lu, Boyu
    Nasrabadi, Nasser M.
    2015 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2015, : 2868 - 2871
  • [33] TASK-DRIVEN DICTIONARY LEARNING FOR INPAINTING
    Hu, Huiyi
    Wohlberg, Brendt
    Chartrand, Rick
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [34] Task-driven approach to artificial intelligence*
    Vityaev, E. E.
    Goncharov, S. S.
    Sviridenko, D. I.
    COGNITIVE SYSTEMS RESEARCH, 2023, 81 : 50 - 56
  • [35] A Task-driven Grammar Refactoring Algorithm
    Halupka, Ivan
    Kollar, Jan
    Pietrikova, Emilia
    ACTA POLYTECHNICA, 2012, 52 (05) : 51 - 57
  • [36] Detection of functional brain network reconfiguration during task-driven cognitive states
    Telesford, Qawi K.
    Lynall, Mary-Ellen
    Vettel, Jean
    Miller, Michael B.
    Grafton, Scott T.
    Bassett, Danielle S.
    NEUROIMAGE, 2016, 142 : 188 - 200
  • [37] Task-Driven Deep Image Enhancement Network for Autonomous Driving in Bad Weather
    Lee, Younkwan
    Jeon, Jihyo
    Ko, Yeongmin
    Jeon, Byunggwan
    Jeon, Moongu
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 13746 - 13753
  • [38] Teaching Reform of "Computer Network Technology" Curriculum Based on Task-driven Method
    Li, Miaoyan
    Zhang, Kai
    Zhang, Yue
    2011 AASRI CONFERENCE ON INFORMATION TECHNOLOGY AND ECONOMIC DEVELOPMENT (AASRI-ITED 2011), VOL 2, 2011, : 332 - 335
  • [39] Task-driven common subspace learning based semantic feature extraction for acoustic event recognition
    Shi, Qiuying
    Deng, Shiwen
    Han, Jiqing
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 234
  • [40] SOCIAL INTELLIGENCE FOR A TASK-DRIVEN ASSISTIVE ROBOT
    Nejat, Goldie
    Ficocelli, Maurizio
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE 2010, VOL 2, PTS A AND B, 2010, : 1555 - 1563