Bias alleviating generative adversarial network for generalized zero-shot classification

被引:6
|
作者
Li, Xiao [1 ]
Fang, Min [1 ]
Li, Haikun [1 ]
机构
[1] Xidian Univ, Sch Comp Sci & Technol, Xian 710071, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Generalized zero shot classification; Generative adversarial network; Unseen visual prototypes; Cluster centers; Semantic relationships;
D O I
10.1016/j.imavis.2020.104077
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generalized zero-shot classification is predicting the labels of the test images coming from seen or unseen classes. The task is difficult because of the bias problem, that is, unseen samples are easily to be misclassified to seen classes. Many methods have handled the problem by training a generative adversarial network (GAN) to generate fake samples. However, the GAN model trained with seen samples might not be appropriate for generating unseen samples. For dealing with this problem, we learn a bias alleviating generative adversarial network for generalized zero-shot classification by generating seen and unseen samples, simultaneously. We train the generator to generate more realistic unseen samples by adding semantic similarity and cluster center regularizations to alleviate the bias problem. The semantic similarity regularization is to restrict the relationships of the generated unseen visual prototypes and seen visual prototypes by their class prototypes to avoid the generated unseen samples similar to the seen samples. The cluster center regularization is to utilize the cluster property of target data to make the generated unseen visual prototypes near to the most similar cluster centers, generating realistic unseen samples. From the experiments, we can see the proposed method achieves promising results. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] A Generative Framework for Zero-Shot Learning with Adversarial Domain Adaptation
    Khare, Varun
    Mahajan, Divyat
    Bharadhwaj, Homanga
    Verma, Vinay Kumar
    Rai, Piyush
    [J]. 2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 3090 - 3099
  • [22] Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphs
    Qin, Pengda
    Wang, Xin
    Chen, Wenhu
    Zhang, Chunyun
    Xu, Weiran
    Wang, William Yang
    [J]. THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 8673 - 8680
  • [23] SR-GAN: SEMANTIC RECTIFYING GENERATIVE ADVERSARIAL NETWORK FOR ZERO-SHOT LEARNING
    Ye, Zihan
    Lyu, Fan
    Li, Linyan
    Fu, Qiming
    Ren, Jinchang
    Hu, Fuyuan
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 85 - 90
  • [24] Zero-shot Cross-modal Retrieval by Assembling AutoEncoder and Generative Adversarial Network
    Xu, Xing
    Tian, Jialin
    Lin, Kaiyi
    Lu, Huimin
    Shao, Jie
    Shen, Heng Tao
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (01)
  • [25] Augmented semantic feature based generative network for generalized zero-shot learning
    Li, Zhiqun
    Chen, Qiong
    Liu, Qingfa
    [J]. NEURAL NETWORKS, 2021, 143 : 1 - 11
  • [26] Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning
    Ni, Jian
    Zhang, Shanghang
    Xie, Haiyong
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [27] A structure-enhanced generative adversarial network for knowledge graph zero-shot relational learning
    Li, Xuewei
    Ma, Jinming
    Yu, Jian
    Zhao, Mankun
    Yu, Mei
    Liu, Hongwei
    Ding, Weiping
    Yu, Ruiguo
    [J]. INFORMATION SCIENCES, 2023, 629 : 169 - 183
  • [28] Zero-Shot Action Recognition with Knowledge Enhanced Generative Adversarial Networks
    Huang, Kaiqiang
    Miralles-Pechuan, Luis
    Mckeever, Susan
    [J]. PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL INTELLIGENCE (IJCCI), 2021, : 254 - 264
  • [29] Conditional Coupled Generative Adversarial Networks for Zero-Shot Domain Adaptation
    Wang, Jinghua
    Jiang, Jianmin
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3374 - 3383
  • [30] ZeroNAS: Differentiable Generative Adversarial Networks Search for Zero-Shot Learning
    Yan, Caixia
    Chang, Xiaojun
    Li, Zhihui
    Guan, Weili
    Ge, Zongyuan
    Zhu, Lei
    Zheng, Qinghua
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 9733 - 9740