Cross-media retrieval based on linear discriminant analysis

被引:5
|
作者
Qi, Yudan [1 ]
Zhang, Huaxiang [1 ,2 ]
Zhang, Bin [1 ]
Wang, Li [1 ]
Zheng, Shunxin [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Shandong, Peoples R China
[2] Shandong Normal Univ, Inst Data Sci & Technol, Jinan 250014, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-media retrieval; Correlation analysis; Semantic information; Linear discriminant analysis;
D O I
10.1007/s11042-018-6994-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Existing cross-media retrieval approaches usually project low-level features from different modalities of data into a common subspace, in which the similarity of multi-modal data can be measured directly. However, most of the previous subspace learning methods ignore the discriminative property of multi-modal data which may lead to suboptimal cross-media retrieval performance. To address this problem, we propose a novel approach to cross-media retrieval framework based on Linear Discriminant Analysis (LDA), which integrates the correlation between textual features and visual features to learn a pair of projection matrices so that we can project the low-level heterogeneous features into a shared feature space by the transformation matrices. Thus the discriminative characteristic of textual modality is transferred to the corresponding visual features via the correlation analysis process. Experiments on three benchmark datasets show the effectiveness of our approach.
引用
收藏
页码:24249 / 24268
页数:20
相关论文
共 50 条
  • [31] Manifold learning based cross-media retrieval: A solution to media object complementary nature
    Zhuang, Yueting
    Yang, Yi
    Wu, Fei
    Pan, Yunhe
    JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2007, 46 (2-3): : 153 - 164
  • [32] Manifold Learning Based Cross-media Retrieval: A Solution to Media Object Complementary Nature
    Yueting Zhuang
    Yi Yang
    Fei Wu
    Yunhe Pan
    The Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology, 2007, 46 : 153 - 164
  • [33] CROSS-MODALITY CORRELATION PROPAGATION FOR CROSS-MEDIA RETRIEVAL
    Zhai, Xiaohua
    Peng, Yuxin
    Xiao, Jianguo
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 2337 - 2340
  • [34] Cross-Media Intelligent Perception and Retrieval Analysis Application Technology Based on Deep Learning Education
    Liu, Hean
    Ko, Young Chun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2021, 35 (15)
  • [35] Toward cross-language and cross-media image retrieval
    Alvarez, C
    Oumohmed, AI
    Mignotte, M
    Nie, JY
    MULTILINGUAL INFORMATION ACCESS FOR TEXT, SPEECH AND IMAGES, 2005, 3491 : 676 - 687
  • [36] LEARNING OPTIMAL DATA REPRESENTATION FOR CROSS-MEDIA RETRIEVAL
    Zhang, Hong
    Chen, Li
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1925 - 1928
  • [37] Complementary information retrieval for cross-media news content
    Ma, Qiang
    Nadamoto, Akiyo
    Tanaka, Katsumi
    INFORMATION SYSTEMS, 2006, 31 (07) : 659 - 678
  • [38] Cross-media retrieval with collective deep semantic learning
    Bin Zhang
    Lei Zhu
    Jiande Sun
    Huaxiang Zhang
    Multimedia Tools and Applications, 2018, 77 : 22247 - 22266
  • [39] An analysis of cross-media transfers
    Phillips, JB
    Hindawi, MA
    Phillips, A
    Bailey, RV
    POLLUTION ENGINEERING, 1997, 29 (06) : 41 - +
  • [40] Finding the best picture: Cross-media retrieval of content
    Deschacht, Koen
    Moens, Marie-Francine
    ADVANCES IN INFORMATION RETRIEVAL, 2008, 4956 : 539 - 546