Data driven recurrent generative adversarial network for generalized zero shot image classification

被引:6
|
作者
Zhang, Jie [1 ]
Liao, Shengbin [2 ]
Zhang, Haofeng [1 ]
Long, Yang [3 ]
Zhang, Zheng [4 ]
Liu, Li [5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
[2] Huazhong Normal Univ, Natl Engn Res Ctr E Learning, Wuhan, Peoples R China
[3] Univ Durham, Sch Comp Sci, Durham, England
[4] Harbin Inst Technol, Biocomp Res Ctr, Shenzhen, Peoples R China
[5] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Generalized zero-shot learning; Data-driven sampling; Prototype synthesis; Recurrent adversarial network;
D O I
10.1016/j.ins.2023.01.039
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional Generative Adversarial Network (GAN) based Generalized Zero Shot Learning (GZSL) methods usually suffer from a problem that these methods ignore the differences between classes when using the standard normal distribution to fit the true distribution of each category, and the incompleteness of a single adversarial training makes the model unable to capture all the characteristics of the samples. To address this problem, a data-driven recurrent adversarial generative network is proposed in this paper. We first synthe-size visual prototypes for unseen classes using the transformation from semantic attributes to visual prototypes learned on seen classes. Then, some noise is generated from these pro-totypes to synthesize the unseen samples according to the corresponding semantic attri-butes. During the sample generation process, a recurrent generative adversarial network is designed to facilitate the generated visual features to be more representative. Extensive experiments on five popular datasets as well as detailed ablation studies demon-strate the effectiveness and superiority of the proposed method.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页码:536 / 552
页数:17
相关论文
共 50 条
  • [1] Bias alleviating generative adversarial network for generalized zero-shot classification
    Li, Xiao
    Fang, Min
    Li, Haikun
    [J]. IMAGE AND VISION COMPUTING, 2021, 105
  • [2] Triple discriminator generative adversarial network for zero-shot image classification
    Zhong JI
    Jiangtao YAN
    Qiang WANG
    Yanwei PANG
    Xuelong LI
    [J]. Science China(Information Sciences), 2021, 64 (02) : 5 - 18
  • [3] Triple discriminator generative adversarial network for zero-shot image classification
    Zhong Ji
    Jiangtao Yan
    Qiang Wang
    Yanwei Pang
    Xuelong Li
    [J]. Science China Information Sciences, 2021, 64
  • [4] Triple discriminator generative adversarial network for zero-shot image classification
    Ji, Zhong
    Yan, Jiangtao
    Wang, Qiang
    Pang, Yanwei
    Li, Xuelong
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)
  • [5] Special Modality independent adversarial network for generalized zero shot image classification
    Zhang, Haofeng
    Wang, Yinduo
    Long, Yang
    Yang, Longzhi
    Shao, Ling
    [J]. NEURAL NETWORKS, 2021, 134 : 11 - 22
  • [6] Zero shot image classification system using an optimized generalized adversarial network
    Kavitha, Ch
    Rao, M. Babu
    Srikanth, B.
    Rao, A. Srinivasa
    Nagesh, A. Sri
    Kumar, K. Kranthi
    [J]. WIRELESS NETWORKS, 2023, 29 (02) : 697 - 712
  • [7] Zero shot image classification system using an optimized generalized adversarial network
    Ch Kavitha
    M. Babu Rao
    B. Srikanth
    A. Srinivasa Rao
    A. Sri Nagesh
    K. Kranthi Kumar
    [J]. Wireless Networks, 2023, 29 : 697 - 712
  • [8] Generative Dual Adversarial Network for Generalized Zero-shot Learning
    Huang, He
    Wang, Changhu
    Yu, Philip S.
    Wang, Chang-Dong
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 801 - 810
  • [9] Generalized Zero-Shot Video Classification via Generative Adversarial Networks
    Hong, Mingyao
    Li, Guorong
    Zhang, Xinfeng
    Huang, Qingming
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2419 - 2426
  • [10] A generative adversarial network with “zero-shot” learning for positron image denoising
    Mingwei Zhu
    Min Zhao
    Min Yao
    Ruipeng Guo
    [J]. Scientific Reports, 13