Unsupervised Concept Learning in Text Subspace for Cross-Media Retrieval

被引:0
|
作者
Fan, Mengdi [1 ]
Wang, Wenmin [1 ]
Dong, Peilei [1 ]
Wang, Ronggang [1 ]
Li, Ge [1 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Lishui Rd 2199, Shenzhen 518055, Peoples R China
关键词
Unsupervised; Concept learning; Text subspace; Cross-media retrieval; Neural networks;
D O I
10.1007/978-3-319-77380-3_48
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Subspace (i.e. image, text or latent subspace) learning is one of the essential parts in cross-media retrieval. And most of the existing methods deal with mapping different modalities to the latent subspace pre-defined by category labels. However, the labels need a lot of manual annotation, and the label concerned subspace may not be exact enough to represent the semantic information. In this paper, we propose a novel unsupervised concept learning approach in text subspace for cross-media retrieval, which can map images and texts to a conceptual text subspace via the neural networks trained by self-learned concept labels, therefore the well-established text subspace is more reasonable and practicable than pre-defined latent subspace. Experiments demonstrate that our proposed method not only outperforms the state-of-the-art unsupervised methods but achieves better performance than several supervised methods on two benchmark datasets.
引用
收藏
页码:505 / 514
页数:10
相关论文
共 50 条
  • [41] Discovering Semantic Vocabularies for Cross-Media Retrieval
    Habibian, Amirhossein
    Mensink, Thomas
    Snoek, Cees G. M.
    ICMR'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2015, : 131 - 138
  • [42] Relative image similarity learning with contextual information for Internet cross-media retrieval
    Shuqiang Jiang
    Xinhang Song
    Qingming Huang
    Multimedia Systems, 2014, 20 : 645 - 657
  • [43] Cross-media retrieval based on semi-supervised regularization and correlation learning
    Hong Zhang
    Gang Dai
    Du Tang
    Xin Xu
    Multimedia Tools and Applications, 2018, 77 : 22455 - 22473
  • [44] MARS: Learning Modality-Agnostic Representation for Scalable Cross-Media Retrieval
    Wang, Yunbo
    Peng, Yuxin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4765 - 4777
  • [45] Relative image similarity learning with contextual information for Internet cross-media retrieval
    Jiang, Shuqiang
    Song, Xinhang
    Huang, Qingming
    MULTIMEDIA SYSTEMS, 2014, 20 (06) : 645 - 657
  • [46] Cross-media retrieval based on semi-supervised regularization and correlation learning
    Zhang, Hong
    Dai, Gang
    Tang, Du
    Xu, Xin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (17) : 22455 - 22473
  • [47] MOON: Multi-hash codes joint learning for cross-media retrieval
    Zhang, Donglin
    Wu, Xiao-Jun
    Yin, He-Feng
    Kittler, Josef
    PATTERN RECOGNITION LETTERS, 2021, 151 : 19 - 25
  • [48] CROSS-MODALITY CORRELATION PROPAGATION FOR CROSS-MEDIA RETRIEVAL
    Zhai, Xiaohua
    Peng, Yuxin
    Xiao, Jianguo
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 2337 - 2340
  • [49] Toward cross-language and cross-media image retrieval
    Alvarez, C
    Oumohmed, AI
    Mignotte, M
    Nie, JY
    MULTILINGUAL INFORMATION ACCESS FOR TEXT, SPEECH AND IMAGES, 2005, 3491 : 676 - 687
  • [50] Bagging-based cross-media retrieval algorithm
    Xu, Gongwen
    Zhang, Yu
    Yin, Mingshan
    Hong, Wenzhong
    Zou, Ran
    Wang, Shanshan
    SOFT COMPUTING, 2023, 27 (05) : 2615 - 2623