Variational Disentangle Zero-Shot Learning

被引:0
|
作者
Su, Jie [1 ]
Wan, Jinhao [2 ]
Li, Taotao [2 ]
Li, Xiong [2 ]
Ye, Yuheng [2 ]
机构
[1] Newcastle Univ, Sch Comp, Newcastle Upon Tyne NE4 5TG, England
[2] Zhejiang Univ Technol, ISPNU Lab, Hangzhou 310023, Peoples R China
关键词
zero-shot learning; computer science; pattern recognition; deep learning;
D O I
10.3390/math11163578
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Existing zero-shot learning (ZSL) methods typically focus on mapping from the feature space (e.g., visual space) to class-level attributes, often leading to a non-injective projection. Such a mapping may cause a significant loss of instance-level information. While an ideal projection to instance-level attributes would be desirable, it can also be prohibitively expensive and thus impractical in many scenarios. In this work, we propose a variational disentangle zero-shot learning (VDZSL) framework that addresses this problem by constructing variational instance-specific attributes from a class-specific semantic latent distribution. Specifically, our approach disentangles each instance into class-specific attributes and the corresponding variant features. Unlike transductive ZSL, which assumes that unseen classes' attributions are known beforehand, our VDZSL method does not rely on this strong assumption, making it more applicable in real-world scenarios. Extensive experiments conducted on three popular ZSL benchmark datasets (i.e., AwA2, CUB, and FLO) validate the effectiveness of our approach. In the conventional ZSL setting, our method demonstrates an improvement of 12 similar to 15% relative to the advanced approaches and achieves a classification accuracy of 70% on the AwA2 dataset. Furthermore, under the more challenging generalized ZSL setting, our approach can gain an improvement of 5 similar to 15% compared with the advanced methods.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Generalized Zero-Shot Learning using Identifiable Variational Autoencoders
    Gull, Muqaddas
    Arif, Omar
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 191
  • [2] Variational Zero-Shot Multispectral Pansharpening
    Rui, Xiangyu
    Cao, Xiangyong
    Li, Yining
    Meng, Deyu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] A Variational Autoencoder with Deep Embedding Model for Generalized Zero-Shot Learning
    Ma, Peirong
    Hu, Xiao
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11733 - 11740
  • [4] Multi-Label Zero-Shot Learning With Adversarial and Variational Techniques
    Gull, Muqaddas
    Arif, Omar
    IEEE ACCESS, 2024, 12 : 94990 - 95006
  • [5] A Discriminative Cross-Aligned Variational Autoencoder for Zero-Shot Learning
    Liu, Yang
    Gao, Xinbo
    Han, Jungong
    Shao, Ling
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) : 3794 - 3805
  • [6] Ordinal Zero-Shot Learning
    Huo, Zengwei
    Geng, Xin
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1916 - 1922
  • [7] Zero-Shot Kernel Learning
    Zhang, Hongguang
    Koniusz, Piotr
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7670 - 7679
  • [8] Zero-shot causal learning
    Nilforoshan, Hamed
    Moor, Michael
    Roohani, Yusuf
    Chen, Yining
    Surina, Anja
    Yasunaga, Michihiro
    Oblak, Sara
    Leskovec, Jure
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Zero-shot Metric Learning
    Xu, Xinyi
    Cao, Huanhuan
    Yang, Yanhua
    Yang, Erkun
    Deng, Cheng
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3996 - 4002
  • [10] Active Zero-Shot Learning
    Xie, Sihong
    Wang, Shaoxiong
    Yu, Philip S.
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 1889 - 1892