A new algorithm for solving a class of matrix optimization problem arising in unsupervised feature selection

被引:0
|
作者
Yang, Naya [1 ,2 ]
Duan, Xuefeng [1 ,2 ]
Li, Chunmei [1 ,2 ]
Wang, Qingwen [3 ]
机构
[1] Guilin Univ Elect Technol, Coll Math & Computat Sci, Guangxi Coll, Ctr Appl Math Guangxi GUET, Guilin 541004, Guangxi, Peoples R China
[2] Guilin Univ Elect Technol, Univ Key Lab Data Anal & Computat, Guilin 541004, Guangxi, Peoples R China
[3] Shanghai Univ, Dept Math, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Matrix optimization problem; Online optimization algorithm; Convergence analysis; Unsupervised feature selection; FACTORIZATION;
D O I
10.1007/s11075-024-01997-4
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
In this paper, we consider a class of matrix optimization problem in unsupervised feature selection, which has many applications in machine learning, pattern detection and data mining. A sparse graph-constrained matrix optimization model is established and it can preserve the local geometric structure of the feature manifold. Based on the idea of Monte Carlo, the matrix optimization problem is firstly transformed into a stochastic programming problem and then an online optimization algorithm has been designed to solve this model. Different from traditional feature selection methods, the new algorithm can better deal with big data and data stream problems. Numerical results show that the new method is feasible and effective. Especially, some simulation experiments in unsupervised feature selection illustrate that our algorithm is more effective than the existed algorithms.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] Ordinal preserving matrix factorization for unsupervised feature selection
    Yi, Yugen
    Zhou, Wei
    Liu, Qinghua
    Luo, Guoliang
    Wang, Jianzhong
    Fang, Yuming
    Zheng, Caixia
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 67 : 118 - 131
  • [32] Feature selection based on fuzzy extension matrix for multi-class problem
    Wang, XZ
    Lu, XY
    Zhang, F
    PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 2032 - 2035
  • [33] A novel binary horse herd optimization algorithm for feature selection problem
    Zahra Asghari Varzaneh
    Soodeh Hosseini
    Mohammad Masoud Javidi
    Multimedia Tools and Applications, 2023, 82 : 40309 - 40343
  • [34] Binary Bamboo Forest Growth Optimization Algorithm for Feature Selection Problem
    Pan, Jeng-Shyang
    Yue, Longkang
    Chu, Shu-Chuan
    Hu, Pei
    Yan, Bin
    Yang, Hongmei
    ENTROPY, 2023, 25 (02)
  • [35] An ensemble of intelligent water drop algorithm for feature selection optimization problem
    Alijla, Basem O.
    Lim, Chee Peng
    Wong, Li-Pei
    Khader, Ahamad Tajudin
    Al-Betar, Mohammed Azmi
    APPLIED SOFT COMPUTING, 2018, 65 : 531 - 541
  • [36] A novel binary horse herd optimization algorithm for feature selection problem
    Asghari Varzaneh, Zahra
    Hosseini, Soodeh
    Javidi, Mohammad Masoud
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (26) : 40309 - 40343
  • [37] A new hybrid ant colony optimization algorithm for feature selection
    Kabir, Md. Monirul
    Shahjahan, Md.
    Murase, Kazuyuki
    EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (03) : 3747 - 3763
  • [38] Algorithmic Stability and Generalization of an Unsupervised Feature Selection Algorithm
    Wu, Xinxing
    Cheng, Qiang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [39] An Unsupervised Feature Selection Algorithm with Feature Ranking for Maximizing Performance of the Classifiers
    Danasingh Asir Antony Gnana Singh
    Subramanian Appavu Alias Balamurugan
    Epiphany Jebamalar Leavline
    International Journal of Automation and Computing, 2015, 12 (05) : 511 - 517
  • [40] Unsupervised Feature Selection Using Binary Bat Algorithm
    Rani, A. Sylvia Selva
    Rajalaxmi, R. R.
    2015 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION SYSTEMS (ICECS), 2015, : 451 - 456