A NON-CONVEX PROXIMAL APPROACH FOR CENTROID-BASED CLASSIFICATION

被引:0
|
作者
Kahanam, Mewe-Hezoudah [1 ]
Le-Brusquet, Laurent [2 ]
Martin, Segolene [1 ]
Pesquet, Jean-Christophe [1 ]
机构
[1] Univ Paris Saclay, CentraleSupelec, Inria, Ctr Vis Numer, Gif Sur Yvette, France
[2] Univ Paris Saclay, CentraleSupelec, CNRS, Lab Signaux & Syst, Gif Sur Yvette, France
关键词
Supervised classification; centroid-based classification; non-convex optimization; transform learning;
D O I
10.1109/ICASSP43922.2022.9747071
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In this paper, we propose a novel variational approach for supervised classification based on transform learning. Our approach consists of formulating an optimization problem on both the transform matrix and the centroids of the classes in a low-dimensional transformed space. The loss function is based on the distance to the centroids, which can be chosen in a flexible manner. To avoid trivial solutions or highly correlated clusters, our model incorporates a penalty term on the centroids, which encourages them to be separated. The resulting non-convex and non-smooth minimization problem is then solved by a primal-dual alternating minimization strategy. We assess the performance of our method on a bunch of supervised classification problems and compare it to state-of-the-art methods.
引用
收藏
页码:5702 / 5706
页数:5
相关论文
共 50 条
  • [21] Regret Minimization in Stochastic Non-Convex Learning via a Proximal-Gradient Approach
    Hallak, Nadav
    Mertikopoulos, Panayotis
    Cevher, Volkan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [22] RANDOM CENTROID INITIALIZATION FOR IMPROVING CENTROID-BASED CLUSTERING
    Romanuke V.V.
    Decision Making: Applications in Management and Engineering, 2023, 6 (02): : 734 - 746
  • [23] Centroid-based sifting for empiricalmode decomposition
    Hong, Hong
    Wang, Xin-Long
    Tao, Zhi-Yong
    Du, Shuan-Ping
    Journal of Zhejiang University: Science C, 2011, 12 (02): : 88 - 95
  • [24] Graph and Centroid-based Word Clustering
    Thaiprayoon, Santipong
    Unger, Herwig
    Kubek, Mario
    2020 4TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND INFORMATION RETRIEVAL, NLPIR 2020, 2020, : 163 - 168
  • [25] GLOBAL OPTIMIZATION FOR NON-CONVEX PROGRAMS VIA CONVEX PROXIMAL POINT METHOD
    Zhao, Yuanyi
    Xing, Wenxun
    JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2023, 19 (06) : 4591 - 4614
  • [26] Nesting of non-convex figures in non-convex contours
    Vinade, C.
    Dias, A.
    Informacion Tecnologica, 2000, 11 (01): : 149 - 156
  • [27] Three-way open intent classification with nearest centroid-based representation
    Li, Yanhua
    Liu, Jiafen
    Yang, Longhao
    Pan, Chaofan
    Wang, Xiangkun
    Yang, Xin
    INFORMATION SCIENCES, 2024, 681
  • [28] A Centroid-Based Outlier Detection Method
    Wang, Xiaochun
    Chen, Yiqin
    Wang, Xia Li
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2017, : 1411 - 1416
  • [29] Centroid-based maximum intensity projections
    Cash, DM
    Palmisano, MG
    Galloway, RL
    JOURNAL OF COMPUTER ASSISTED TOMOGRAPHY, 2002, 26 (01) : 73 - 83
  • [30] Centroid-based summarization of multiple documents
    Radev, DR
    Jing, HY
    Stys, M
    Tam, D
    INFORMATION PROCESSING & MANAGEMENT, 2004, 40 (06) : 919 - 938