Dual-verification network for zero-shot learning

被引:26
|
作者
Zhang, Haofeng [1 ]
Long, Yang [2 ]
Yang, Wankou [3 ]
Shao, Ling [4 ,5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Newcastle Univ, Sch Comp, Open Lab, Newcastle Upon Tyne, Tyne & Wear, England
[3] Southeast Univ, Sch Automat, Nanjing, Jiangsu, Peoples R China
[4] IIAI, Abu Dhabi, U Arab Emirates
[5] Univ East Anglia, Sch Comp Sci, Norwich, Norfolk, England
基金
中国国家自然科学基金;
关键词
Zero-shot learning; Dual-verification net; Orthogonal projection; Semantic feature representation; DEEP FEATURE; CLASSIFICATION;
D O I
10.1016/j.ins.2018.08.048
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To mitigate the problems of visual ambiguity and domain shift in conventional zero-shot learning (ZSL), in this paper, we propose a novel method, namely, dual-verification network (DVN), which accepts features and attributes in a pairwise manner as input and verifies the result in both the attribute and feature spaces. First, the DVN projects a feature onto an orthogonal space, where the projected feature has maximum correlation with its corresponding attribute and is orthogonal to all the other attributes. Second, we adopt the concept of semantic feature representation, which computes the relationship between the semantic feature and class labels. Based on this concept, we project the attributes onto the feature space by extending the attributes and labels from the class level to instance level. In addition, we employ a deep architecture and utilize the cross entropy loss to train an end-to-end network for dual verification. Extensive experiments in ZSL and generalized ZSL are performed on four well-known datasets, and the results show that the proposed DVN exhibits a competitive performance relative to the state-of-the-art methods. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:43 / 57
页数:15
相关论文
共 50 条
  • [31] Contrast and Aggregation Network for Generalized Zero-shot Learning
    Li, Bin
    Xie, Cheng
    Yang, Jingqi
    Duan, Haoran
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT II, 2022, 13530 : 383 - 394
  • [32] Zero-Shot Learning for Raw Network Traffic Detection
    Rani, Pooja
    Bastian, Nathaniel D.
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS VI, 2024, 13051
  • [33] Isolation and distillation network for generalized zero-shot learning
    Liang Y.
    Cao W.
    Neural Computing and Applications, 2024, 36 (22) : 13935 - 13955
  • [34] Zero-Shot Learning via Contrastive Learning on Dual Knowledge Graphs
    Wang, Jin
    Jiang, Bo
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 885 - 892
  • [35] Dual Projective Zero-Shot Learning Using Text Descriptions
    Rao, Yunbo
    Yang, Ziqiang
    Zeng, Shaoning
    Wang, Qifeng
    Pu, Jiansu
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (01)
  • [36] Ordinal Zero-Shot Learning
    Huo, Zengwei
    Geng, Xin
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 1916 - 1922
  • [37] Zero-Shot Kernel Learning
    Zhang, Hongguang
    Koniusz, Piotr
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7670 - 7679
  • [38] Zero-shot causal learning
    Nilforoshan, Hamed
    Moor, Michael
    Roohani, Yusuf
    Chen, Yining
    Surina, Anja
    Yasunaga, Michihiro
    Oblak, Sara
    Leskovec, Jure
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [39] Dual VAEGAN: A generative model for generalized zero-shot learning
    Luo, Yuxuan
    Wang, Xizhao
    Pourpanah, Farhad
    APPLIED SOFT COMPUTING, 2021, 107
  • [40] Zero-shot Metric Learning
    Xu, Xinyi
    Cao, Huanhuan
    Yang, Yanhua
    Yang, Erkun
    Deng, Cheng
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3996 - 4002