Classifier and Exemplar Synthesis for Zero-Shot Learning

被引:34
|
作者
Changpinyo, Soravit [1 ]
Chao, Wei-Lun [2 ]
Gong, Boqing [3 ]
Sha, Fei [4 ]
机构
[1] Google AI, Los Angeles, CA 90095 USA
[2] Cornell Univ, Dept Comp Sci, Ithaca, NY 14853 USA
[3] Google, Seattle, WA USA
[4] Univ Southern Calif, Dept Comp Sci, Los Angeles, CA 90007 USA
基金
美国国家科学基金会;
关键词
Zero-shot learning; Generalized zero-shot learning; Transfer learning; Object recognition; Semantic embeddings; Evaluation metrics; DATABASE;
D O I
10.1007/s11263-019-01193-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot learning (ZSL) enables solving a task without the need to see its examples. In this paper, we propose two ZSL frameworks that learn to synthesize parameters for novel unseen classes. First, we propose to cast the problem of ZSL as learning manifold embeddings from graphs composed of object classes, leading to a flexible approach that synthesizes "classifiers" for the unseen classes. Then, we define an auxiliary task of synthesizing "exemplars" for the unseen classes to be used as an automatic denoising mechanism for any existing ZSL approaches or as an effective ZSL model by itself. On five visual recognition benchmark datasets, we demonstrate the superior performances of our proposed frameworks in various scenarios of both conventional and generalized ZSL. Finally, we provide valuable insights through a series of empirical analyses, among which are a comparison of semantic representations on the full ImageNet benchmark as well as a comparison of metrics used in generalized ZSL. Our code and data are publicly available at .
引用
收藏
页码:166 / 201
页数:36
相关论文
共 50 条
  • [1] Classifier and Exemplar Synthesis for Zero-Shot Learning
    Soravit Changpinyo
    Wei-Lun Chao
    Boqing Gong
    Fei Sha
    [J]. International Journal of Computer Vision, 2020, 128 : 166 - 201
  • [2] Discriminative comparison classifier for generalized zero-shot learning
    Hou, Mingzhen
    Xia, Wei
    Zhang, Xiangdong
    Gao, Quanxue
    [J]. NEUROCOMPUTING, 2020, 414 : 10 - 17
  • [3] Knowledge Distillation Classifier Generation Network for Zero-Shot Learning
    Yu, Yunlong
    Li, Bin
    Ji, Zhong
    Han, Jungong
    Zhang, Zhongfei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (06) : 3183 - 3194
  • [4] Write a Classifier: Zero-Shot Learning Using Purely Textual Descriptions
    Elhoseiny, Mohamed
    Saleh, Babak
    Elgammal, Ahmed
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 2584 - 2591
  • [5] Random Forest Classifier for Zero-Shot Learning Based on Relative Attribute
    Cheng, Yuhu
    Qiao, Xue
    Wang, Xuesong
    Yu, Qiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (05) : 1662 - 1674
  • [6] Ordinal Zero-Shot Learning
    Huo, Zengwei
    Geng, Xin
    [J]. PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1916 - 1922
  • [7] Zero-Shot Kernel Learning
    Zhang, Hongguang
    Koniusz, Piotr
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7670 - 7679
  • [8] Zero-shot causal learning
    Nilforoshan, Hamed
    Moor, Michael
    Roohani, Yusuf
    Chen, Yining
    Surina, Anja
    Yasunaga, Michihiro
    Oblak, Sara
    Leskovec, Jure
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Incremental Zero-Shot Learning
    Wei, Kun
    Deng, Cheng
    Yang, Xu
    Tao, Dacheng
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) : 13788 - 13799
  • [10] Rebalanced Zero-Shot Learning
    Ye, Zihan
    Yang, Guanyu
    Jin, Xiaobo
    Liu, Youfa
    Huang, Kaizhu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 4185 - 4198