Zero-shot leaning and hashing with binary visual similes

被引:10
|
作者
Zhang, Haofeng [1 ]
Long, Yang [2 ]
Shao, Ling [3 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
[2] Newcastle Univ, Sch Comp, Open Lab, Newcastle Upon Tyne, Tyne & Wear, England
[3] Incept Inst Artificial Intelligence IIAI, Abu Dhabi, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Zero-shot learning; Zero-shot hashing; Visual similes; Binary annotation;
D O I
10.1007/s11042-018-6842-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Conventional zero-shot learning methods usually learn mapping functions to project image features into semantic embedding spaces, in which to find the nearest neighbors with predefined attributes. The predefined attributes including both seen classes and unseen classes are often annotated with high dimensional real values by experts, which costs a lot of human labors. In this paper, we propose a simple but effective method to reduce the annotation work. In our strategy, only unseen classes are needed to be annotated with several binary codes, which lead to only about one percent of original annotation work. In addition, we design a Visual Similes Annotation System (ViSAS) to annotate the unseen classes, and build both linear and deep mapping models and test them on four popular datasets, the experimental results show that our method can outperform the state-of-the-art methods in most circumstances.
引用
收藏
页码:24147 / 24165
页数:19
相关论文
共 50 条
  • [1] Zero-shot leaning and hashing with binary visual similes
    Haofeng Zhang
    Yang Long
    Ling Shao
    Multimedia Tools and Applications, 2019, 78 : 24147 - 24165
  • [2] Zero-Shot Leaning with Manifold Embedding
    Yu, Yun-long
    Ji, Zhong
    Pang, Yan-wei
    INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING, 2018, 11266 : 135 - 147
  • [3] ATTRIBUTE HASHING FOR ZERO-SHOT IMAGE RETRIEVAL
    Xu, Yahui
    Yang, Yang
    Shen, Fumin
    Xu, Xing
    Zhou, Yuxuan
    Shen, Heng Tao
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 133 - 138
  • [4] Zero-Shot Sketch-Image Hashing
    Shen, Yuming
    Liu, Li
    Shen, Fumin
    Shao, Ling
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3598 - 3607
  • [5] Cross-modal Zero-shot Hashing
    Liu, Xuanwu
    Li, Zhao
    Wang, Jun
    Yu, Guoxian
    Domeniconi, Carlotta
    Zhang, Xiangliang
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 449 - 458
  • [6] Zero-Shot Visual Imitation
    Pathak, Deepak
    Mahmoudieh, Parsa
    Luo, Guanghao
    Agrawal, Pulkit
    Chen, Dian
    Shentu, Fred
    Shelhamer, Evan
    Malik, Jitendra
    Efros, Alexei A.
    Darrell, Trevor
    PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 2131 - 2134
  • [7] SEMANTIC AUGMENTATION HASHING FOR ZERO-SHOT IMAGE RETRIEVAL
    Zhong, Fangming
    Chen, Zhikui
    Min, Geyong
    Xia, Feng
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 1943 - 1947
  • [8] Zero-shot Hashing with orthogonal projection for image retrieval
    Zhang, Haofeng
    Long, Yang
    Shao, Ling
    PATTERN RECOGNITION LETTERS, 2019, 117 : 201 - 209
  • [9] Zero-Shot Hashing via Transferring Supervised Knowledge
    Yang, Yang
    Luo, Yadan
    Chen, Weilun
    Shen, Fumin
    Shao, Jie
    Shen, Heng Tao
    MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 1286 - 1295
  • [10] Transductive Zero-Shot Hashing for Multilabel Image Retrieval
    Zou, Qin
    Cao, Ling
    Zhang, Zheng
    Chen, Long
    Wang, Song
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (04) : 1673 - 1687