Text Dimensionality Reduction with Mutual Information Preserving Mapping

被引:0
|
作者
YANG Zhen [1 ,2 ]
YAO Fei [1 ]
FAN Kefeng [3 ]
HUANG Jian [4 ]
机构
[1] College of Computer Science,Beijing University of Technology
[2] Guangxi Colleges and Universities Key Laboratory of cloud computing and complex systems,Guilin University of Electronic Technology
[3] China Electronics Standardization Institute
[4] Central University of Finance and Economics
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Manifold learning; Temporal summarization; Mutual information preserving mapping(MIPM);
D O I
暂无
中图分类号
TP391.1 [文字信息处理];
学科分类号
081203 ; 0835 ;
摘要
With the explosion of information,it is becoming increasingly difficult to get what is really wanted.Dimensionality reduction is the first step in efficient processing of large data.Although dimensionality can be reduced in many ways,little work has been done to achieve dimensionality reduction without changing the inner semantic relationship among high dimension data.To remedy this problem,we introduced a manifold learning based method,named Mutual information preserving mapping(MIPM),to explore the low-dimensional,neighborhood and mutual information preserving embeddings of highdimensional inputs.Experimental results show that the proposed method is effective for the text dimensionality reduction task.The MIPM was used to develop a temporal summarization system for efficiently monitoring the information associated with an event over time.With respect to the established baselines,results of these experiments show that our method is effective in the temporal summarization.
引用
收藏
页码:919 / 925
页数:7
相关论文
共 50 条
  • [1] Text Dimensionality Reduction with Mutual Information Preserving Mapping
    Yang Zhen
    Yao Fei
    Fan Kefeng
    Huang Jian
    [J]. CHINESE JOURNAL OF ELECTRONICS, 2017, 26 (05) : 919 - 925
  • [2] Dimensionality Reduction by Mutual Information for Text Classification
    刘丽珍
    宋瀚涛
    陆玉昌
    [J]. Journal of Beijing Institute of Technology, 2005, (01) : 32 - 36
  • [3] Information Preserving Dimensionality Reduction for Mutual Information Analysis of Deep Learning
    Namekawa, Shizuma
    Tezuka, Taro
    [J]. DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 477 - 477
  • [4] Information Preserving Dimensionality Reduction
    Kushagra, Shrinu
    Ben-David, Shai
    [J]. ALGORITHMIC LEARNING THEORY, ALT 2015, 2015, 9355 : 239 - 253
  • [5] Mutual Information Based Output Dimensionality Reduction
    Pandey, Shishir
    Vaze, Rahul
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2014, : 935 - 940
  • [6] Quadratic mutual information for dimensionality reduction and classification
    Gray, David M.
    Principe, Jose C.
    [J]. AUTOMATIC TARGET RECOGNITION XX; ACQUISITION, TRACKING, POINTING, AND LASER SYSTEMS TECHNOLOGIES XXIV; AND OPTICAL PATTERN RECOGNITION XXI, 2010, 7696
  • [7] Dimensionality reduction by semantic mapping in text categorization
    Corrêa, RF
    Ludermir, TB
    [J]. NEURAL INFORMATION PROCESSING, 2004, 3316 : 1032 - 1037
  • [8] Dimensionality reduction via preserving local information
    Wang, Shangguang
    Ding, Chuntao
    Hsu, Ching-Hsien
    Yang, Fangchun
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 967 - 975
  • [9] Multifactor dimensionality reduction using normalized mutual information
    Bush, W. S.
    Edwards, T. L.
    Dudek, S. M.
    Ritchie, M. D.
    [J]. GENETIC EPIDEMIOLOGY, 2007, 31 (05) : 464 - 464
  • [10] Dimensionality reduction based on non-parametric mutual information
    Faivishevsky, Lev
    Goldberger, Jacob
    [J]. NEUROCOMPUTING, 2012, 80 : 31 - 37