Improved t-SNE based manifold dimensional reduction for remote sensing data processing

被引:0
|
作者
Weijing Song
Lizhe Wang
Peng Liu
Kim-Kwang Raymond Choo
机构
[1] China University of Geosciences,College of Computer Science
[2] Chinese Academy of Sciences,Institute of Remote Sensing and Digital Earth
[3] University of Texas at San Antonio,Department of Information Systems and Cyber Security and Department of Electrical and Computer Engineering
来源
关键词
Remote sensing big data; Manifold learning; T-SNE; 2-mixed Gaussian model (GMM); Probability distribution;
D O I
暂无
中图分类号
学科分类号
摘要
In our increasingly “data-abundant” society, remote sensing big data perform massive, high dimension and heterogeneity features, which could result in “dimension disaster” to various extent. It is worth mentioning that the past two decades have witnessed a number of dimensional reductions to weak the spatiotemporal redundancy and simplify the calculation in remote sensing information extraction, such as the linear learning methods or the manifold learning methods. However, the “crowding” and mixing when reducing dimensions of remote sensing categories could degrade the performance of existing techniques. Then in this paper, by analyzing probability distribution of pairwise distances among remote sensing datapoints, we use the 2-mixed Gaussian model(GMM) to improve the effectiveness of the theory of t-Distributed Stochastic Neighbor Embedding (t-SNE). A basic reducing dimensional model is given to test our proposed methods. The experiments show that the new probability distribution capable retains the local structure and significantly reveals differences between categories in a global structure.
引用
收藏
页码:4311 / 4326
页数:15
相关论文
共 50 条
  • [1] Improved t-SNE based manifold dimensional reduction for remote sensing data processing
    Song, Weijing
    Wang, Lizhe
    Liu, Peng
    Choo, Kim-Kwang Raymond
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (04) : 4311 - 4326
  • [2] t-SNE for Complex Multi-Manifold High-Dimensional Data
    Bian R.
    Zhang J.
    Zhou L.
    Jiang P.
    Chen B.
    Wang Y.
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2021, 33 (11): : 1746 - 1754
  • [3] Examining Intermediate Data Reduction Algorithms for use with t-SNE
    Campbell, Aaron
    Caudle, Kyle
    Hoover, Randy C.
    [J]. PROCEEDINGS OF THE 2019 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTE AND DATA ANALYSIS (ICCDA 2019), 2019, : 36 - 42
  • [4] An automatic affinity propagation clustering based on improved equilibrium optimizer and t-SNE for high-dimensional data
    Duan, Yuxian
    Liu, Changyun
    Li, Song
    Guo, Xiangke
    Yang, Chunlin
    [J]. INFORMATION SCIENCES, 2023, 623 : 434 - 454
  • [5] Visualizing Data using t-SNE
    van der Maaten, Laurens
    Hinton, Geoffrey
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2008, 9 : 2579 - 2605
  • [6] S plus t-SNE - Bringing Dimensionality Reduction to Data Streams
    Vieira, Pedro C.
    Montrezol, Joao P.
    Vieira, Joao T.
    Gama, Joao
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS XXII, PT II, IDA 2024, 2024, 14642 : 95 - 106
  • [7] t-SNE Manifold Learning Based Visualization: A Human Activity Recognition Approach
    Dharavath, Ramesh
    MadhukarRao, G.
    Khurana, Himanshu
    Edla, Damodar Reddy
    [J]. ADVANCES IN DATA SCIENCE AND MANAGEMENT, 2020, 37 : 33 - 43
  • [8] Automating t-SNE parameterization with prototype-based learning of manifold connectivity
    Taylor, Josh
    Merenyi, Erzsebet
    [J]. NEUROCOMPUTING, 2022, 507 : 441 - 452
  • [9] Visualizing data using t-SNE
    TiCC, Ttlburg University, P.O. Box 90153, 5000 LE Tilburg, Netherlands
    不详
    [J]. J. Mach. Learn. Res., 2008, (2579-2625):
  • [10] Dimensionality reduction and visualisation of hyperspectral ink data using t-SNE
    Devassy, Binu Melit
    George, Sony
    [J]. FORENSIC SCIENCE INTERNATIONAL, 2020, 311