Bias alleviating generative adversarial network for generalized zero-shot classification

被引:6
|
作者
Li, Xiao [1 ]
Fang, Min [1 ]
Li, Haikun [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generalized zero shot classification; Generative adversarial network; Unseen visual prototypes; Cluster centers; Semantic relationships;
D O I
10.1016/j.imavis.2020.104077
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generalized zero-shot classification is predicting the labels of the test images coming from seen or unseen classes. The task is difficult because of the bias problem, that is, unseen samples are easily to be misclassified to seen classes. Many methods have handled the problem by training a generative adversarial network (GAN) to generate fake samples. However, the GAN model trained with seen samples might not be appropriate for generating unseen samples. For dealing with this problem, we learn a bias alleviating generative adversarial network for generalized zero-shot classification by generating seen and unseen samples, simultaneously. We train the generator to generate more realistic unseen samples by adding semantic similarity and cluster center regularizations to alleviate the bias problem. The semantic similarity regularization is to restrict the relationships of the generated unseen visual prototypes and seen visual prototypes by their class prototypes to avoid the generated unseen samples similar to the seen samples. The cluster center regularization is to utilize the cluster property of target data to make the generated unseen visual prototypes near to the most similar cluster centers, generating realistic unseen samples. From the experiments, we can see the proposed method achieves promising results. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Generative Dual Adversarial Network for Generalized Zero-shot Learning
    Huang, He
    Wang, Changhu
    Yu, Philip S.
    Wang, Chang-Dong
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 801 - 810
  • [2] Generalized Zero-Shot Video Classification via Generative Adversarial Networks
    Hong, Mingyao
    Li, Guorong
    Zhang, Xinfeng
    Huang, Qingming
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2419 - 2426
  • [3] Triple discriminator generative adversarial network for zero-shot image classification
    Ji, Zhong
    Yan, Jiangtao
    Wang, Qiang
    Pang, Yanwei
    Li, Xuelong
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)
  • [4] Triple discriminator generative adversarial network for zero-shot image classification
    Zhong Ji
    Jiangtao Yan
    Qiang Wang
    Yanwei Pang
    Xuelong Li
    [J]. Science China Information Sciences, 2021, 64
  • [5] Triple discriminator generative adversarial network for zero-shot image classification
    Zhong JI
    Jiangtao YAN
    Qiang WANG
    Yanwei PANG
    Xuelong LI
    [J]. Science China(Information Sciences), 2021, 64 (02) : 5 - 18
  • [6] Generative Adversarial Networks for Zero-Shot Remote Sensing Scene Classification
    Li, Zihao
    Zhang, Daobing
    Wang, Yang
    Lin, Daoyu
    Zhang, Jinghua
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (08):
  • [7] Data driven recurrent generative adversarial network for generalized zero shot image classification
    Zhang, Jie
    Liao, Shengbin
    Zhang, Haofeng
    Long, Yang
    Zhang, Zheng
    Liu, Li
    [J]. INFORMATION SCIENCES, 2023, 625 : 536 - 552
  • [8] Multi-modal generative adversarial network for zero-shot learning
    Ji, Zhong
    Chen, Kexin
    Wang, Junyue
    Yu, Yunlong
    Zhang, Zhongfei
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 197
  • [9] A generative adversarial network with “zero-shot” learning for positron image denoising
    Mingwei Zhu
    Min Zhao
    Min Yao
    Ruipeng Guo
    [J]. Scientific Reports, 13
  • [10] ROBUST BIDIRECTIONAL GENERATIVE NETWORK FOR GENERALIZED ZERO-SHOT LEARNING
    Xing, Yun
    Huang, Sheng
    Huangfu, Luwen
    Chen, Feiyu
    Ge, Yongxin
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,