Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels

被引:0
|
作者
Xu, Shu-Lin [1 ,2 ]
Sun, Yifan [3 ]
Zhang, Faen [4 ]
Xu, Anqi [5 ]
Wei, Xiu-Shen [1 ,2 ]
Yang, Yi [6 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Southeast Univ, Key Lab New Generat Artificial Intelligence Techn, Nanjing, Peoples R China
[3] Baidu Inc, Beijing, Peoples R China
[4] AInnovat Technol Grp Co Ltd, San Jose, CA USA
[5] Univ Toronto, Toronto, ON, Canada
[6] Zhejiang Univ, Coll Comp Sci & Technol, CCAI, Hangzhou, Peoples R China
来源
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023) | 2023年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning fine-grained embeddings from coarse labels is a challenging task due to limited label granularity supervision, i.e., lacking the detailed distinctions required for fine-grained tasks. The task becomes even more demanding when attempting few-shot fine-grained recognition, which holds practical significance in various applications. To address these challenges, we propose a novel method that embeds visual embeddings into a hyperbolic space and enhances their discriminative ability with a hierarchical cosine margins manner. Specifically, the hyperbolic space offers distinct advantages, including the ability to capture hierarchical relationships and increased expressive power, which favors modeling fine-grained objects. Based on the hyperbolic space, we further enforce relatively large/small similarity margins between coarse/fine classes, respectively, yielding the so-called hierarchical cosine margins manner. While enforcing similarity margins in the regular Euclidean space has become popular for deep embedding learning, applying it to the hyperbolic space is non-trivial and validating the benefit for coarse-to-fine generalization is valuable. Extensive experiments conducted on five benchmark datasets showcase the effectiveness of our proposed method, yielding state-of-the-art results surpassing competing methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Hierarchical Memory Learning for Fine-Grained Scene Graph Generation
    Deng, Youming
    Li, Yansheng
    Zhang, Yongjun
    Xiang, Xiang
    Wang, Jian
    Chen, Jingdong
    Ma, Jiayi
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 266 - 283
  • [22] Enhanced Adjacency-Constrained Hierarchical Clustering Using Fine-Grained Pseudo Labels
    Yang, Jie
    Lin, Chin-Teng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (03): : 2481 - 2492
  • [23] Recover Fine-Grained Spatial Data from Coarse Aggregation
    Liu, Bang
    Mavrin, Borislav
    Kong, Linglong
    Niu, Di
    2017 17TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2017, : 961 - 966
  • [24] Fine-grained Network Traffic Prediction from Coarse Data
    Rusek, Krzysztof
    Drton, Mathias
    AUSTRIAN JOURNAL OF STATISTICS, 2022, : 114 - 123
  • [25] Coarse- and Fine-Grained Fusion Hierarchical Network for Hole Filling in View Synthesis
    Wang, Guangcheng
    Jiang, Kui
    Gu, Ke
    Liu, Hongyan
    Liu, Hantao
    Zhang, Wenjun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 322 - 337
  • [26] Improve Fine-Grained Feature Learning in Fine-Grained DataSet GAI
    Wang, Hai Peng
    Geng, Zhi Qing
    IEEE ACCESS, 2025, 13 : 12777 - 12788
  • [27] Consistency Checking for Refactoring from Coarse-Grained Locks to Fine-Grained Locks
    Zhang, Yang
    Liu, Jingjing
    Qi, Lin
    Meredith, Grant
    INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2024, 34 (07) : 1063 - 1093
  • [28] EXPLOITING COARSE-TO-FINE MECHANISM FOR FINE-GRAINED RECOGNITION
    Wang, Yongzhong
    Zhang, Xu-Yao
    Zhang, Yanming
    Hou, Xinwen
    Liu, Cheng-Lin
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 649 - 653
  • [29] Coarse-to-Fine Description for Fine-Grained Visual Categorization
    Yao, Hantao
    Zhang, Shiliang
    Zhang, Yongdong
    Li, Jintao
    Tian, Qi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (10) : 4858 - 4872
  • [30] EGGAN: Learning Latent Space for Fine-Grained Expression Manipulation
    Tang, Junshu
    Shao, Zhiwen
    Ma, Lizhuang
    IEEE MULTIMEDIA, 2021, 28 (03) : 42 - 51