Hyperbolic Space with Hierarchical Margin Boosts Fine-Grained Learning from Coarse Labels

被引:0
|
作者
Xu, Shu-Lin [1 ,2 ]
Sun, Yifan [3 ]
Zhang, Faen [4 ]
Xu, Anqi [5 ]
Wei, Xiu-Shen [1 ,2 ]
Yang, Yi [6 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Southeast Univ, Key Lab New Generat Artificial Intelligence Techn, Nanjing, Peoples R China
[3] Baidu Inc, Beijing, Peoples R China
[4] AInnovat Technol Grp Co Ltd, San Jose, CA USA
[5] Univ Toronto, Toronto, ON, Canada
[6] Zhejiang Univ, Coll Comp Sci & Technol, CCAI, Hangzhou, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning fine-grained embeddings from coarse labels is a challenging task due to limited label granularity supervision, i.e., lacking the detailed distinctions required for fine-grained tasks. The task becomes even more demanding when attempting few-shot fine-grained recognition, which holds practical significance in various applications. To address these challenges, we propose a novel method that embeds visual embeddings into a hyperbolic space and enhances their discriminative ability with a hierarchical cosine margins manner. Specifically, the hyperbolic space offers distinct advantages, including the ability to capture hierarchical relationships and increased expressive power, which favors modeling fine-grained objects. Based on the hyperbolic space, we further enforce relatively large/small similarity margins between coarse/fine classes, respectively, yielding the so-called hierarchical cosine margins manner. While enforcing similarity margins in the regular Euclidean space has become popular for deep embedding learning, applying it to the hyperbolic space is non-trivial and validating the benefit for coarse-to-fine generalization is valuable. Extensive experiments conducted on five benchmark datasets showcase the effectiveness of our proposed method, yielding state-of-the-art results surpassing competing methods.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Fine-grained Angular Contrastive Learning with Coarse Labels
    Bukchin, Guy
    Schwartz, Eli
    Saenko, Kate
    Shahar, Ori
    Feris, Rogerio
    Giryes, Raja
    Karlinsky, Leonid
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 8726 - 8736
  • [2] Grafit: Learning fine-grained image representations with coarse labels
    Touvron, Hugo
    Sablayrolles, Alexandre
    Douze, Matthijs
    Cord, Matthieu
    Jegou, Herve
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 854 - 864
  • [3] WEAKLY SUPERVISED CLUSTERING: LEARNING FINE-GRAINED SIGNALS FROM COARSE LABELS
    Wager, Stefan
    Blocker, Alexander
    Cardin, Niall
    ANNALS OF APPLIED STATISTICS, 2015, 9 (02): : 801 - 820
  • [4] Learning fast and fine-grained detection of amyloid neuropathologies from coarse-grained expert labels
    Wong, Daniel R.
    Magaki, Shino D.
    Vinters, Harry V.
    Yong, William H.
    Monuki, Edwin S.
    Williams, Christopher K.
    Martini, Alessandra C.
    DeCarli, Charles
    Khacherian, Chris
    Graff, John P.
    Dugger, Brittany N.
    Keiser, Michael J.
    COMMUNICATIONS BIOLOGY, 2023, 6 (01)
  • [5] Learning fine-grained estimation of physiological states from coarse-grained labels by distribution restoration
    Zengyi Qin
    Jiansheng Chen
    Zhenyu Jiang
    Xumin Yu
    Chunhua Hu
    Yu Ma
    Suhua Miao
    Rongsong Zhou
    Scientific Reports, 10
  • [6] Learning fast and fine-grained detection of amyloid neuropathologies from coarse-grained expert labels
    Daniel R. Wong
    Shino D. Magaki
    Harry V. Vinters
    William H. Yong
    Edwin S. Monuki
    Christopher K. Williams
    Alessandra C. Martini
    Charles DeCarli
    Chris Khacherian
    John P. Graff
    Brittany N. Dugger
    Michael J. Keiser
    Communications Biology, 6
  • [7] Learning fine-grained estimation of physiological states from coarse-grained labels by distribution restoration
    Qin, Zengyi
    Chen, Jiansheng
    Jiang, Zhenyu
    Yu, Xumin
    Hu, Chunhua
    Ma, Yu
    Miao, Suhua
    Zhou, Rongsong
    SCIENTIFIC REPORTS, 2020, 10 (01)
  • [8] FINE-GRAINED IMAGE CLASSIFICATION WITH COARSE AND FINE LABELS ON ONE-SHOT LEARNING
    Jiao, Qihan
    Liu, Zhi
    Li, Gongyang
    Ye, Linwei
    Wang, Yang
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [9] Fine-Grained Entity Typing in Hyperbolic Space
    Lopez, Federico
    Heinzerling, Benjamin
    Strube, Michael
    4TH WORKSHOP ON REPRESENTATION LEARNING FOR NLP (REPL4NLP-2019), 2019, : 169 - 180
  • [10] Weakly labeled fine-grained classification with hierarchy relationship of fine and coarse labels
    Jiao, Qihan
    Liu, Zhi
    Ye, Linwei
    Wang, Yang
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 63