Dual-verification network for zero-shot learning

被引:26
|
作者
Zhang, Haofeng [1 ]
Long, Yang [2 ]
Yang, Wankou [3 ]
Shao, Ling [4 ,5 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Newcastle Univ, Sch Comp, Open Lab, Newcastle Upon Tyne, Tyne & Wear, England
[3] Southeast Univ, Sch Automat, Nanjing, Jiangsu, Peoples R China
[4] IIAI, Abu Dhabi, U Arab Emirates
[5] Univ East Anglia, Sch Comp Sci, Norwich, Norfolk, England
基金
中国国家自然科学基金;
关键词
Zero-shot learning; Dual-verification net; Orthogonal projection; Semantic feature representation; DEEP FEATURE; CLASSIFICATION;
D O I
10.1016/j.ins.2018.08.048
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To mitigate the problems of visual ambiguity and domain shift in conventional zero-shot learning (ZSL), in this paper, we propose a novel method, namely, dual-verification network (DVN), which accepts features and attributes in a pairwise manner as input and verifies the result in both the attribute and feature spaces. First, the DVN projects a feature onto an orthogonal space, where the projected feature has maximum correlation with its corresponding attribute and is orthogonal to all the other attributes. Second, we adopt the concept of semantic feature representation, which computes the relationship between the semantic feature and class labels. Based on this concept, we project the attributes onto the feature space by extending the attributes and labels from the class level to instance level. In addition, we employ a deep architecture and utilize the cross entropy loss to train an end-to-end network for dual verification. Extensive experiments in ZSL and generalized ZSL are performed on four well-known datasets, and the results show that the proposed DVN exhibits a competitive performance relative to the state-of-the-art methods. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:43 / 57
页数:15
相关论文
共 50 条
  • [1] Triple Verification Network for Generalized Zero-Shot Learning
    Zhang, Haofeng
    Long, Yang
    Guan, Yu
    Shao, Ling
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) : 506 - 517
  • [2] Dual Part Discovery Network for Zero-Shot Learning
    Ge, Jiannan
    Xie, Hongtao
    Min, Shaobo
    Li, Pandeng
    Zhang, Yongdong
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3244 - 3252
  • [3] Dual triplet network for image zero-shot learning
    Ji, Zhong
    Wang, Hai
    Pang, Yanwei
    Shao, Ling
    NEUROCOMPUTING, 2020, 373 : 90 - 97
  • [4] Dual Expert Distillation Network for Generalized Zero-Shot Learning
    Rao, Zhijie
    Guo, Jingcai
    Lu, Xiaocheng
    Liang, Jingming
    Zhang, Jie
    Wang, Haozhao
    Wei, Kang
    Cao, Xiaofeng
    PROCEEDINGS OF THE THIRTY-THIRD INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2024, 2024, : 4833 - 4841
  • [5] Dual Prototype Contrastive Network for Generalized Zero-Shot Learning
    Jiang, Huajie
    Li, Zhengxian
    Hu, Yongli
    Yin, Baocai
    Yang, Jian
    van den Hengel, Anton
    Yang, Ming-Hsuan
    Qi, Yuankai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (02) : 1111 - 1122
  • [6] Dual-focus transfer network for zero-shot learning
    Jia, Zhen
    Zhang, Zhang
    Shan, Caifeng
    Wang, Liang
    Tan, Tieniu
    NEUROCOMPUTING, 2023, 541
  • [7] Generative Dual Adversarial Network for Generalized Zero-shot Learning
    Huang, He
    Wang, Changhu
    Yu, Philip S.
    Wang, Chang-Dong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 801 - 810
  • [8] Dual Progressive Prototype Network for Generalized Zero-Shot Learning
    Wang, Chaoqun
    Mina, Shaobo
    Chenl, Xuejin
    Sun, Xiaoyan
    Li, Houqiang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [9] Dual-level contrastive learning network for generalized zero-shot learning
    Jiaqi Guan
    Min Meng
    Tianyou Liang
    Jigang Liu
    Jigang Wu
    The Visual Computer, 2022, 38 : 3087 - 3095
  • [10] Dual-level contrastive learning network for generalized zero-shot learning
    Guan, Jiaqi
    Meng, Min
    Liang, Tianyou
    Liu, Jigang
    Wu, Jigang
    VISUAL COMPUTER, 2022, 38 (9-10): : 3087 - 3095