Unsupervised cycle-consistent deformation for shape matching

被引:15
|
作者
Groueix, Thibault [1 ]
Fisher, Matthew [2 ]
Kim, Vladimir G. [2 ]
Russell, Bryan C. [2 ]
Aubry, Mathieu [1 ]
机构
[1] UPE, Ecole Ponts, LIGM UMR 8049, Paris, France
[2] Adobe Res, Paris, France
关键词
NONRIGID REGISTRATION; OPTIMIZATION; MAPS;
D O I
10.1111/cgf.13794
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a self-supervised approach to deep surface deformation. Given a pair of shapes, our algorithm directly predicts a parametric transformation from one shape to the other respecting correspondences. Our insight is to use cycle-consistency to define a notion of good correspondences in groups of objects and use it as a supervisory signal to train our network. Our method combines does not rely on a template, assume near isometric deformations or rely on point-correspondence supervision. We demonstrate the efficacy of our approach by using it to transfer segmentation across shapes. We show, on Shapenet, that our approach is competitive with comparable state-of-the-art methods when annotated training data is readily available, but outperforms them by a large margin in the few-shot segmentation scenario.
引用
收藏
页码:123 / 133
页数:11
相关论文
共 50 条
  • [1] Unsupervised cycle-consistent person pose transfer
    Liu, Songyan
    Guo, Haiyun
    Zhu, Kuan
    Wang, Jinqiao
    Tang, Ming
    [J]. NEUROCOMPUTING, 2021, 453 : 502 - 511
  • [2] Unsupervised data to content transformation with histogram-matching cycle-consistent generative adversarial networks
    Ihle, Stephan J.
    Reichmuth, Andreas M.
    Girardin, Sophie
    Han, Hana
    Stauffer, Flurin
    Bonnin, Anne
    Stampanoni, Marco
    Pattisapu, Karthik
    Voeroes, Janos
    Forro, Csaba
    [J]. NATURE MACHINE INTELLIGENCE, 2019, 1 (10) : 461 - 470
  • [3] Unsupervised data to content transformation with histogram-matching cycle-consistent generative adversarial networks
    Stephan J. Ihle
    Andreas M. Reichmuth
    Sophie Girardin
    Hana Han
    Flurin Stauffer
    Anne Bonnin
    Marco Stampanoni
    Karthik Pattisapu
    János Vörös
    Csaba Forró
    [J]. Nature Machine Intelligence, 2019, 1 : 461 - 470
  • [4] Unsupervised Deformable Image Registration Using Cycle-Consistent CNN
    Kim, Boah
    Kim, Jieun
    Lee, June-Goo
    Kim, Dong Hwan
    Park, Seong Ho
    Ye, Jong Chul
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 : 166 - 174
  • [5] Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening
    Zhou, Huanyu
    Liu, Qingjie
    Weng, Dawei
    Wang, Yunhong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Unsupervised cycle-consistent adversarial attacks for visual object tracking
    Yao, Rui
    Zhu, Xiangbin
    Zhou, Yong
    Shao, Zhiwen
    Hu, Fuyuan
    Zhang, Yanning
    [J]. DISPLAYS, 2023, 80
  • [7] Unsupervised Video Summarization With Cycle-Consistent Adversarial LSTM Networks
    Yuan, Li
    Tay, Francis Eng Hock
    Li, Ping
    Feng, Jiashi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) : 2711 - 2722
  • [8] Unsupervised Image Dedusting via a Cycle-Consistent Generative Adversarial Network
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    [J]. REMOTE SENSING, 2023, 15 (05)
  • [9] Cycle-SUM: Cycle-Consistent Adversarial LSTM Networks for Unsupervised Video Summarization
    Yuan, Li
    Tay, Francis E. H.
    Li, Ping
    Zhou, Li
    Feng, Jiashi
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 9143 - 9150
  • [10] CycleMatch: A cycle-consistent embedding network for image-text matching
    Liu, Yu
    Guo, Yanming
    Liu, Li
    Bakker, Erwin M.
    Lew, Michael S.
    [J]. PATTERN RECOGNITION, 2019, 93 : 365 - 379