Unsupervised Learning of Robust Spectral Shape Matching

被引:12
|
作者
Cao, Dongliang [1 ]
Roetzer, Paul [1 ]
Bernard, Florian [1 ]
机构
[1] Univ Bonn, Friedrich Hirzebruch Allee 5, D-53115 Bonn, Germany
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 04期
关键词
Shape matching; deep learning; functional maps; MAPS;
D O I
10.1145/3592107
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a novel learning-based approach for robust 3D shape matching. Our method builds upon deep functional maps and can be trained in a fully unsupervised manner. Previous deep functional map methods mainly focus on predicting optimised functional maps alone, and then rely on off-the-shelf post-processing to obtain accurate point-wise maps during inference. However, this two-stage procedure for obtaining point-wise maps often yields sub-optimal performance. In contrast, building upon recent insights about the relation between functional maps and point-wise maps, we propose a novel unsupervised loss to couple the functional maps and point-wise maps, and thereby directly obtain point-wise maps without any post-processing. Our approach obtains accurate correspondences not only for near-isometric shapes, but also for more challenging non-isometric shapes and partial shapes, as well as shapes with different discretisation or topological noise. Using a total of nine diverse datasets, we extensively evaluate the performance and demonstrate that our method substantially outperforms previous state-of-the-art methods, even compared to recent supervised methods. Our code is available at https://github.com/dongliangcao/Unsupervised-Learning-of-Robust-Spectral-Shape-Matching.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Unsupervised Deep Learning for Structured Shape Matching
    Roufosse, Jean-Michel
    Sharma, Abhishek
    Ovsjanikov, Maks
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1617 - 1627
  • [2] Robust Spectral Learning for Unsupervised Feature Selection
    Shi, Lei
    Du, Liang
    Shen, Yi-Dong
    2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2014, : 977 - 982
  • [3] Learning Multi-resolution Functional Maps with Spectral Attention for Robust Shape Matching
    Li, Lei
    Donati, Nicolas
    Ovsjanikov, Maks
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Unsupervised Cross-Spectral Stereo Matching by Learning to Synthesize
    Liang, Mingyang
    Guo, Xiaoyang
    Li, Hongsheng
    Wang, Xiaogang
    Song, You
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8706 - 8713
  • [5] Unsupervised thresholds for shape matching
    Musé, P
    Sur, FD
    Cao, F
    Gousseau, Y
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 2, PROCEEDINGS, 2003, : 647 - 650
  • [6] SPATIAL-AWARENESS SPECTRAL EMBEDDING (SASE) FOR ROBUST SHAPE MATCHING
    Xu, Huihui
    Liu, Jundong
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 2075 - 2079
  • [7] Robust shape matching
    Sebe, N
    Lew, M
    IMAGE AND VIDEO RETRIEVAL, 2002, 2383 : 17 - 28
  • [8] Robust blind spectral unmixing for fluorescence microscopy using unsupervised learning
    McRae, Tristan D.
    Oleksyn, David
    Miller, Jim
    Gao, Yu-Rong
    PLOS ONE, 2019, 14 (12):
  • [9] Unsupervised Learning for Graph Matching
    Marius Leordeanu
    Rahul Sukthankar
    Martial Hebert
    International Journal of Computer Vision, 2012, 96 : 28 - 45
  • [10] Unsupervised Learning for Graph Matching
    Leordeanu, Marius
    Sukthankar, Rahul
    Hebert, Martial
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2012, 96 (01) : 28 - 45