Preserving Semantic Relations for Zero-Shot Learning

被引:178
|
作者
Annadani, Yashas [1 ,3 ,4 ,5 ]
Biswas, Soma [2 ]
机构
[1] Natl Inst Technol, Mangalore, Karnataka, India
[2] Indian Inst Sci, Bengaluru, India
[3] IIIT H, Hyderabad, Telangana, India
[4] NITK, Mangalore, India
[5] IISc, Bengaluru, India
关键词
D O I
10.1109/CVPR.2018.00793
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Zero-shot learning has gained popularity due to its potential to scale recognition models without requiring additional training data. This is usually achieved by associating categories with their semantic information like attributes. However, we believe that the potential offered by this paradigm is not yet fully exploited. In this work, we propose to utilize the structure of the space spanned by the attributes using a set of relations. We devise objective functions to preserve these relations in the embedding space, thereby inducing semanticity to the embedding space. Through extensive experimental evaluation on five benchmark datasets, we demonstrate that inducing semanticity to the embedding space is beneficial for zero-shot learning. The proposed approach outperforms the state-of-the-art on the standard zero-shot setting as well as the more realistic generalized zero-shot setting. We also demonstrate how the proposed approach can be useful for making approximate semantic inferences about an image belonging to a category for which attribute information is not available.
引用
收藏
页码:7603 / 7612
页数:10
相关论文
共 50 条
  • [31] Zero-Shot Semantic Segmentation
    Bucher, Maxime
    Vu, Tuan-Hung
    Cord, Matthieu
    Perez, Patrick
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [32] Learning semantic consistency for audio-visual zero-shot learning
    Xiaoyong Li
    Jing Yang
    Yuling Chen
    Wei Zhang
    Xiaoli Ruan
    Chengjiang Li
    Zhidong Su
    Artificial Intelligence Review, 58 (7)
  • [33] JSE: Joint Semantic Encoder for zero-shot gesture learning
    Naveen Madapana
    Juan Wachs
    Pattern Analysis and Applications, 2022, 25 : 679 - 692
  • [34] Semantic Space Analysis for Zero-Shot Learning on SAR Images
    Liu, Bo
    Xu, Jiping
    Zeng, Hui
    Dong, Qiulei
    Hu, Zhanyi
    REMOTE SENSING, 2024, 16 (14)
  • [35] Deep Representation of Hierarchical Semantic Attributes for Zero-shot Learning
    Zhang, Zhaocheng
    Yang, Gang
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [36] Disentangling Semantic-to-Visual Confusion for Zero-Shot Learning
    Ye, Zihan
    Hu, Fuyuan
    Lyu, Fan
    Li, Linyan
    Huang, Kaizhu
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2828 - 2840
  • [37] MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning
    Chen, Shiming
    Hong, Ziming
    Xie, Guo-Sen
    Yang, Wenhan
    Peng, Qinmu
    Wang, Kai
    Zhao, Jian
    You, Xinge
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7602 - 7611
  • [38] Learning discriminative visual semantic embedding for zero-shot recognition
    Xie, Yurui
    Song, Tiecheng
    Yuan, Jianying
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 115
  • [39] Ontology-guided Semantic Composition for Zero-Shot Learning
    Chen, Jiaoyan
    Lecue, Freddy
    Geng, Yuxia
    Pan, Jeff Z.
    Chen, Huajun
    KR2020: PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PRINCIPLES OF KNOWLEDGE REPRESENTATION AND REASONING, 2020, : 850 - 854
  • [40] Transductive semantic knowledge graph propagation for zero-shot learning
    Zhang, Hai-gang
    Que, Hao-yi
    Ren, Jin
    Wu, Zheng-guang
    JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2023, 360 (17): : 13108 - 13125