Unsupervised cycle-consistent deformation for shape matching

被引:15
|
作者
Groueix, Thibault [1 ]
Fisher, Matthew [2 ]
Kim, Vladimir G. [2 ]
Russell, Bryan C. [2 ]
Aubry, Mathieu [1 ]
机构
[1] UPE, Ecole Ponts, LIGM UMR 8049, Paris, France
[2] Adobe Res, Paris, France
关键词
NONRIGID REGISTRATION; OPTIMIZATION; MAPS;
D O I
10.1111/cgf.13794
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We propose a self-supervised approach to deep surface deformation. Given a pair of shapes, our algorithm directly predicts a parametric transformation from one shape to the other respecting correspondences. Our insight is to use cycle-consistency to define a notion of good correspondences in groups of objects and use it as a supervisory signal to train our network. Our method combines does not rely on a template, assume near isometric deformations or rely on point-correspondence supervision. We demonstrate the efficacy of our approach by using it to transfer segmentation across shapes. We show, on Shapenet, that our approach is competitive with comparable state-of-the-art methods when annotated training data is readily available, but outperforms them by a large margin in the few-shot segmentation scenario.
引用
收藏
页码:123 / 133
页数:11
相关论文
共 50 条
  • [21] CyCADA Cycle-Consistent Adversarial Domain Adaptation
    Hoffman, Judy
    Tzeng, Eric
    Park, Taesung
    Zhu, Jun-Yan
    Isola, Phillip
    Saenko, Kate
    Efros, Alexei A.
    Darrell, Trevor
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [22] Cycle-consistent Conditional Adversarial Transfer Networks
    Li, Jingjing
    Chen, Erpeng
    Ding, Zhengming
    Zhu, Lei
    Lu, Ke
    Huang, Zi
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 747 - 755
  • [23] Cycle-Consistent Domain Adaptive Faster RCNN
    Zhang, Dan
    Li, Jingjing
    Xiong, Lin
    Lin, Lan
    Ye, Mao
    Yang, Shangming
    [J]. IEEE ACCESS, 2019, 7 : 123903 - 123911
  • [24] Chest CBCT-based Synthetic CT using Cycle-consistent Adversarial Network with Histogram Matching
    Qiu, Richard L. J.
    Lei, Yang
    Kesarwala, Aparna H.
    Higgins, Kristin
    Bradley, Jeffrey D.
    Curran, Walter J.
    Liu, Tian
    Yang, Xiaofeng
    [J]. MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
  • [25] Neural Topic Modeling with Cycle-Consistent Adversarial Training
    Hu, Xuemeng
    Wang, Rui
    Zhou, Deyu
    Xiong, Yuxuan
    [J]. PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 9018 - 9030
  • [26] Colorization for anime sketches with cycle-consistent adversarial network
    Zhang, Guanghua
    Qu, Mengnan
    Jin, Yuhao
    Song, Qingpeng
    [J]. International Journal of Performability Engineering, 2019, 15 (03) : 910 - 918
  • [27] 3D Pelvic CT-MR Deformable Registration Using Unsupervised Cycle-Consistent FCN
    Guo, Y.
    Wu, X.
    Wang, Z.
    Pei, X.
    Xu, X.
    [J]. MEDICAL PHYSICS, 2020, 47 (06) : E564 - E564
  • [28] Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation
    Xie, Jianwen
    Zheng, Zilong
    Fang, Xiaolin
    Zhu, Song-Chun
    Wu, Ying Nian
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10430 - 10440
  • [29] Blind Image Restoration Based on Cycle-Consistent Network
    Wu, Shixiang
    Dong, Chao
    Qiao, Yu
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1111 - 1124
  • [30] Interactive Elearning Application for Cycle-Consistent Adversarial Networks
    Dragomir, Marilena-Catalina
    Pupezescu, Valentin
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON VIRTUAL LEARNING (ICVL-2020), 2020, : 439 - 444