Improved t-SNE based manifold dimensional reduction for remote sensing data processing

被引:0
|
作者
Weijing Song
Lizhe Wang
Peng Liu
Kim-Kwang Raymond Choo
机构
[1] China University of Geosciences,College of Computer Science
[2] Chinese Academy of Sciences,Institute of Remote Sensing and Digital Earth
[3] University of Texas at San Antonio,Department of Information Systems and Cyber Security and Department of Electrical and Computer Engineering
来源
关键词
Remote sensing big data; Manifold learning; T-SNE; 2-mixed Gaussian model (GMM); Probability distribution;
D O I
暂无
中图分类号
学科分类号
摘要
In our increasingly “data-abundant” society, remote sensing big data perform massive, high dimension and heterogeneity features, which could result in “dimension disaster” to various extent. It is worth mentioning that the past two decades have witnessed a number of dimensional reductions to weak the spatiotemporal redundancy and simplify the calculation in remote sensing information extraction, such as the linear learning methods or the manifold learning methods. However, the “crowding” and mixing when reducing dimensions of remote sensing categories could degrade the performance of existing techniques. Then in this paper, by analyzing probability distribution of pairwise distances among remote sensing datapoints, we use the 2-mixed Gaussian model(GMM) to improve the effectiveness of the theory of t-Distributed Stochastic Neighbor Embedding (t-SNE). A basic reducing dimensional model is given to test our proposed methods. The experiments show that the new probability distribution capable retains the local structure and significantly reveals differences between categories in a global structure.
引用
收藏
页码:4311 / 4326
页数:15
相关论文
共 50 条
  • [21] Dimensionality Reduction via Dynamical Systems: The Case of t-SNE
    Linderman, George C.
    Steinerberger, Stefan
    [J]. SIAM REVIEW, 2022, 64 (01) : 153 - 178
  • [22] A t-SNE based non linear dimension reduction for network intrusion detection
    Hamid Y.
    Sugumaran M.
    [J]. International Journal of Information Technology, 2020, 12 (1) : 125 - 134
  • [23] Visualization of High-Dimensional Data by Pairwise Fusion Matrices Using t-SNE
    Husnain, Mujtaba
    Missen, Malik Muhammad Saad
    Mumtaz, Shahzad
    Luqman, Muhammad Muzzamil
    Coustaty, Mickael
    Ogier, Jean-Marc
    [J]. SYMMETRY-BASEL, 2019, 11 (01):
  • [24] Improved t-SNE in Anomaly Detection of Cloud Virtual Machine
    Zhuang, Fu
    Lin, Guoyuan
    He, Huanye
    Zhang, Yifan
    Li, Yonggang
    Gu, Hao
    [J]. ENTERPRISE INFORMATION SYSTEMS, 2023, 17 (03)
  • [25] Parametric nonlinear dimensionality reduction using kernel t-SNE
    Gisbrecht, Andrej
    Schulz, Alexander
    Hammer, Barbara
    [J]. NEUROCOMPUTING, 2015, 147 : 71 - 82
  • [26] Classification of Categorical Data Based on the Chi-Square Dissimilarity and t-SNE
    Cardona, Luis Ariosto Serna
    Vargas-Cardona, Hernan Dario
    Navarro Gonzalez, Piedad
    Cardenas Pena, David Augusto
    Orozco Gutierrez, Alvaro Angel
    [J]. COMPUTATION, 2020, 8 (04) : 1 - 15
  • [27] Rolling bearing fault diagnosis method based on multiscale time irreversibility and t-SNE manifold learning
    School of Mechanical Engineering, Anhui University of Technology, Maanshan
    243032, China
    [J]. J Vib Shock, 17 (61-68 and 84):
  • [28] t-SNE Based Visualisation and Clustering of Geological Domain
    Balamurali, Mehala
    Melkumyan, Arman
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2016, PT IV, 2016, 9950 : 565 - 572
  • [29] Unsupervised Clustering of Hyperspectral Paper Data Using t-SNE
    Melit Devassy, Binu
    George, Sony
    Nussbaum, Peter
    [J]. JOURNAL OF IMAGING, 2020, 6 (05)
  • [30] Innovative data reduction and visualization strategy for hyperspectral imaging datasets using t-SNE approach
    Pouyet, Emeline
    Rohani, Neda
    Katsaggelos, Aggelos K.
    Cossairt, Oliver
    Walton, Marc
    [J]. PURE AND APPLIED CHEMISTRY, 2018, 90 (03) : 493 - 506