Dual-verification network for zero-shot learning

被引:26
|
作者
Zhang, Haofeng [1 ]
Long, Yang [2 ]
Yang, Wankou [3 ]
Shao, Ling [4 ,5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Newcastle Univ, Sch Comp, Open Lab, Newcastle Upon Tyne, Tyne & Wear, England
[3] Southeast Univ, Sch Automat, Nanjing, Jiangsu, Peoples R China
[4] IIAI, Abu Dhabi, U Arab Emirates
[5] Univ East Anglia, Sch Comp Sci, Norwich, Norfolk, England
基金
中国国家自然科学基金;
关键词
Zero-shot learning; Dual-verification net; Orthogonal projection; Semantic feature representation; DEEP FEATURE; CLASSIFICATION;
D O I
10.1016/j.ins.2018.08.048
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To mitigate the problems of visual ambiguity and domain shift in conventional zero-shot learning (ZSL), in this paper, we propose a novel method, namely, dual-verification network (DVN), which accepts features and attributes in a pairwise manner as input and verifies the result in both the attribute and feature spaces. First, the DVN projects a feature onto an orthogonal space, where the projected feature has maximum correlation with its corresponding attribute and is orthogonal to all the other attributes. Second, we adopt the concept of semantic feature representation, which computes the relationship between the semantic feature and class labels. Based on this concept, we project the attributes onto the feature space by extending the attributes and labels from the class level to instance level. In addition, we employ a deep architecture and utilize the cross entropy loss to train an end-to-end network for dual verification. Extensive experiments in ZSL and generalized ZSL are performed on four well-known datasets, and the results show that the proposed DVN exhibits a competitive performance relative to the state-of-the-art methods. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:43 / 57
页数:15
相关论文
共 50 条
  • [21] Unbiased hybrid generation network for zero-shot learning
    Wang, Zong-Hui
    Lu, Zi-Qian
    Lu, Zhe-Ming
    ELECTRONICS LETTERS, 2020, 56 (18) : 929 - +
  • [22] Transferable Contrastive Network for Generalized Zero-Shot Learning
    Jiang, Huajie
    Wang, Ruiping
    Shan, Shiguang
    Chen, Xilin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9764 - 9773
  • [23] Policy generation network for zero-shot policy learning
    Qian, Yiming
    Zhang, Fengyi
    Liu, Zhiyong
    COMPUTATIONAL INTELLIGENCE, 2023, 39 (05) : 707 - 733
  • [24] Attentive Semantic Preservation Network for Zero-Shot Learning
    Lu, Ziqian
    Yu, Yunlong
    Lu, Zhe-Ming
    Shen, Feng-Li
    Zhang, Zhongfei
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2919 - 2925
  • [25] Dual-Uncertainty Guided Cycle-Consistent Network for Zero-Shot Learning
    Zhang, Yilei
    Tian, Yi
    Zhang, Sihui
    Huang, Yaping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6872 - 6886
  • [26] Generalized Zero-Shot Learning with Deep Calibration Network
    Liu, Shichen
    Long, Mingsheng
    Wang, Jianmin
    Jordan, Michael I.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [27] Zero-Shot Cross-Media Embedding Learning With Dual Adversarial Distribution Network
    Chi, Jingze
    Peng, Yuxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (04) : 1173 - 1187
  • [28] Region Semantically Aligned Network for Zero-Shot Learning
    Wang, Ziyang
    Gou, Yunhao
    Li, Jingjing
    Zhang, Yu
    Yang, Yang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2080 - 2090
  • [29] Attentive Region Embedding Network for Zero-shot Learning
    Xie, Guo-Sen
    Liu, Li
    Jin, Xiaobo
    Zhu, Fan
    Zhang, Zheng
    Qin, Jie
    Yao, Yazhou
    Shao, Ling
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9376 - 9385
  • [30] Attribute Propagation Network for Graph Zero-Shot Learning
    Liu, Lu
    Zhou, Tianyi
    Long, Guodong
    Jiang, Jing
    Zhang, Chengqi
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 4868 - 4875