Transductive Zero-Shot Learning With a Self-Training Dictionary Approach

被引:53
|
作者
Yu, Yunlong [1 ]
Ji, Zhong [2 ]
Li, Xi [3 ]
Guo, Jichang [2 ]
Zhang, Zhongfei [4 ,5 ]
Ling, Haibin [6 ]
Wu, Fei [3 ]
机构
[1] Zhejiang Univ, Hangzhou 310027, Peoples R China
[2] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[3] Zhejiang Univ, Coll Comp Sci, Hangzhou 310027, Peoples R China
[4] Zhejiang Univ, Dept Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
[5] SUNY Binghamton, Watson Sch, Dept Comp Sci, Binghamton, NY 13902 USA
[6] Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA
基金
中国国家自然科学基金;
关键词
Bidirectional mapping; bootstrapping; domain adaptation; transductive learning; zero-shot learning (ZSL);
D O I
10.1109/TCYB.2017.2751741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in the following two aspects: 1) capturing the domain distribution connections between seen classes data and unseen classes data and 2) modeling the semantic interactions between the image feature space and the label embedding space. Motivated by these observations, we propose a bidirectional mapping-based semantic relationship modeling scheme that seeks for cross-modal knowledge transfer by simultaneously projecting the image features and label embeddings into a common latent space. Namely, we have a bidirectional connection relationship that takes place from the image feature space to the latent space as well as from the label embedding space to the latent space. To deal with the domain shift problem, we further present a transductive learning approach that formulates the class prediction problem in an iterative refining process, where the object classification capacity is progressively reinforced through bootstrapping-based model updating over highly reliable instances. Experimental results on four benchmark datasets (animal with attribute, Caltech-UCSD Bird2011, aPascal-aYahoo, and SUN) demonstrate the effectiveness of the proposed approach against the state-of-the-art approaches.
引用
收藏
页码:2908 / 2919
页数:12
相关论文
共 50 条
  • [1] Hardness Sampling for Self-Training Based Transductive Zero-Shot Learning
    Bo, Liu
    Dong, Qiulei
    Hu, Zhanyi
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 16494 - 16503
  • [2] Adversarial strategy for transductive zero-shot learning
    Liu, Youfa
    Du, Bo
    Ni, Fuchuan
    [J]. INFORMATION SCIENCES, 2021, 578 : 750 - 761
  • [3] Zero-shot Text Classification via Reinforced Self-training
    Ye, Zhiquan
    Geng, Yuxia
    Chen, Jiaoyan
    Xu, Xiaoxiao
    Zheng, Suhang
    Wang, Feng
    Chen, Jingmin
    Zhang, Jun
    Chen, Huajun
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3014 - 3024
  • [4] Bidirectional generative transductive zero-shot learning
    Xinpeng Li
    Dan Zhang
    Mao Ye
    Xue Li
    Qiang Dou
    Qiao Lv
    [J]. Neural Computing and Applications, 2021, 33 : 5313 - 5326
  • [5] Transductive Learning for Zero-Shot Object Detection
    Rahman, Shafin
    Khan, Salman
    Barnes, Nick
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6081 - 6090
  • [6] Bidirectional generative transductive zero-shot learning
    Li, Xinpeng
    Zhang, Dan
    Ye, Mao
    Li, Xue
    Dou, Qiang
    Lv, Qiao
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (10): : 5313 - 5326
  • [7] Holistically Associated Transductive Zero-Shot Learning
    Xu, Yangyang
    Xu, Xuemiao
    Han, Guoqiang
    He, Shengfeng
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (02) : 437 - 447
  • [8] Transductive Unbiased Embedding for Zero-Shot Learning
    Song, Jie
    Shen, Chengchao
    Yang, Yezhou
    Liu, Yang
    Song, Mingli
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1024 - 1033
  • [9] Transductive Zero-Shot Learning by Decoupled Feature Generation
    Marmoreo, Federico
    Cavazza, Jacopo
    Murino, Vittorio
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3108 - 3117
  • [10] Transductive Multi-View Zero-Shot Learning
    Fu, Yanwei
    Hospedales, Timothy M.
    Xiang, Tao
    Gong, Shaogang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (11) : 2332 - 2345