Learning local shape descriptors for computing non-rigid dense correspondence

被引:0
|
作者
Jianwei Guo [1 ]
Hanyu Wang [2 ]
Zhanglin Cheng [3 ]
Xiaopeng Zhang [1 ]
Dong-Ming Yan [1 ]
机构
[1] National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences
[2] University of Maryland-College Park
[3] Shenzhen Visu CA Key Lab, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences
基金
中国国家自然科学基金; 国家重点研发计划; 北京市自然科学基金;
关键词
local feature descriptor; triplet CNN; dense correspondence; geometry image; non-rigid shape;
D O I
暂无
中图分类号
TP391.41 []; TP18 [人工智能理论];
学科分类号
080203 ; 081104 ; 0812 ; 0835 ; 1405 ;
摘要
A discriminative local shape descriptor plays an important role in various applications. In this paper, we present a novel deep learning framework that derives discriminative local descriptors for deformable 3D shapes. We use local "geometry images" to encode the multi-scale local features of a point, via an intrinsic parameterization method based on geodesic polar coordinates. This new parameterization provides robust geometry images even for badly-shaped triangular meshes. Then a triplet network with shared architecture and parameters is used to perform deep metric learning;its aim is to distinguish between similar and dissimilar pairs of points. Additionally, a newly designed triplet loss function is minimized for improved, accurate training of the triplet network. To solve the dense correspondence problem, an efficient sampling approach is utilized to achieve a good compromise between training performance and descriptor quality. During testing,given a geometry image of a point of interest, our network outputs a discriminative local descriptor for it.Extensive testing of non-rigid dense shape matching on a variety of benchmarks demonstrates the superiority of the proposed descriptors over the state-of-the-art alternatives.
引用
收藏
页码:95 / 112
页数:18
相关论文
共 50 条
  • [1] Learning local shape descriptors for computing non-rigid dense correspondence
    Guo, Jianwei
    Wang, Hanyu
    Cheng, Zhanglin
    Zhang, Xiaopeng
    Yan, Dong-Ming
    COMPUTATIONAL VISUAL MEDIA, 2020, 6 (01) : 95 - 112
  • [2] Learning local shape descriptors for computing non-rigid dense correspondence
    Jianwei Guo
    Hanyu Wang
    Zhanglin Cheng
    Xiaopeng Zhang
    Dong-Ming Yan
    Computational Visual Media, 2020, 6 : 95 - 112
  • [3] Dense Non-Rigid Shape Correspondence using Random Forests
    Rodola, Emanuele
    Bulo, Samuel Rota
    Windheuser, Thomas
    Vestner, Matthias
    Cremers, Daniel
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 4177 - 4184
  • [4] Simultaneous Pose, Correspondence and Non-Rigid Shape
    Sanchez-Riera, Jordi
    Oestlund, Jonas
    Fua, Pascal
    Moreno-Noguer, Francesc
    2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 1189 - 1196
  • [5] Non-Rigid Dense Correspondence with Applications for Image Enhancement
    HaCohen, Yoav
    Shechtman, Eli
    Goldman, Dan B.
    Lischinski, Dani
    ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (04):
  • [6] Learning 3D Keypoint Descriptors for Non-rigid Shape Matching
    Wang, Hanyu
    Guo, Jianwei
    Yan, Dong-Ming
    Quan, Weize
    Zhang, Xiaopeng
    COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 3 - 20
  • [7] SRFeat: Learning Locally Accurate and Globally Consistent Non-Rigid Shape Correspondence
    Li, Lei
    Attaiki, Souhaib
    Ovsjanikov, Maks
    2022 INTERNATIONAL CONFERENCE ON 3D VISION, 3DV, 2022, : 144 - 154
  • [8] SORCNet: robust non-rigid shape correspondence with enhanced descriptors by Shared Optimized Res-CapsuleNet
    Lian, Yuanfeng
    Gu, Dingru
    Hua, Jing
    VISUAL COMPUTER, 2023, 39 (02): : 749 - 763
  • [9] SORCNet: robust non-rigid shape correspondence with enhanced descriptors by Shared Optimized Res-CapsuleNet
    Yuanfeng Lian
    Dingru Gu
    Jing Hua
    The Visual Computer, 2023, 39 : 749 - 763
  • [10] Shape descriptors for non-rigid shapes with a single closed contour
    Latecki, LJ
    Lakämper, R
    Eckhardt, U
    IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, VOL I, 2000, : 424 - 429