Semi-supervised clustering with two types of background knowledge: Fusing pairwise constraints and monotonicity constraints

被引:0
|
作者
Gonzalez-Almagro, German [1 ,2 ]
Sanchez-Bermejo, Pablo [2 ]
Suarez, Juan Luis [1 ,2 ]
Cano, Jose-Ramon [2 ,3 ]
Garcia, Salvador [1 ,2 ]
机构
[1] Andalusian Inst Data Sci & Computat Intelligence, Granada, Spain
[2] Univ Granada, Dept Comp Sci & Artificial Intelligence DECSAI, Granada, Spain
[3] Univ Jaen, Dept Comp Sci, EPS Linares, Jaen, Andalusia, Spain
关键词
Pairwise constraints; Monotonicity constraints; Expectation-minimization; Semi-supervised learning; Machine learning;
D O I
10.1016/j.inffus.2023.102064
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study addresses the problem of performing clustering in the presence of two types of background knowledge: pairwise constraints and monotonicity constraints. Pairwise constraint relate pair of instances, indicating if they must or must not belong to the same cluster, while monotonicity constraints impose and order relationship between the cluster labels, and are applied to the dataset globally. To fuse these to types of background knowledge, the formal framework to perform clustering under monotonicity constraints is, firstly, defined, resulting in a specific distance measure. Pairwise constraints are integrated afterwards by designing an objective function which combines the proposed distance measure and a pairwise constraint based penalty term, in order to fuse both types of information. This objective function can be optimized with an EM optimization scheme. The proposed method serves as the first approach to the problem it addresses, as it is the first method designed to work with the two types of background knowledge mentioned above. Our proposal is tested with previous approaches from different clustering paradigms in monotonic datasets, including a real-world case of study. Bayesian statistical tests are used to provide empirical evidence in favor of our proposal, and fund subsequent conclusions: the proposed method can be used obtain better results than previous approaches within the monotonic constrained clustering paradigm.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Semi-supervised Clustering with Pairwise and Size Constraints
    Zhang, Shaohong
    Wong, Hau-San
    Xie, Dongqing
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2450 - 2457
  • [2] Semi-supervised DenPeak Clustering with Pairwise Constraints
    Ren, Yazhou
    Hu, Xiaohui
    Shi, Ke
    Yu, Guoxian
    Yao, Dezhong
    Xu, Zenglin
    [J]. PRICAI 2018: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2018, 11012 : 837 - 850
  • [3] Semi-Supervised Maximum Margin Clustering with Pairwise Constraints
    Zeng, Hong
    Cheung, Yiu-Ming
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2012, 24 (05) : 926 - 939
  • [4] Effective semi-supervised graph clustering with pairwise constraints
    Chen, Jingwei
    Xie, Shiyu
    Yang, Hui
    Nie, Feiping
    [J]. INFORMATION SCIENCES, 2024, 681
  • [5] Semi-Supervised Agglomerative Hierarchical Clustering Algorithms with Pairwise Constraints
    Miyamoto, Sadaaki
    Terami, Akihisa
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE 2010), 2010,
  • [6] Consistency regularization for deep semi-supervised clustering with pairwise constraints
    Dan Huang
    Jie Hu
    Tianrui Li
    Shengdong Du
    Hongmei Chen
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 3359 - 3372
  • [7] Semi-supervised Spectral Clustering with automatic propagation of pairwise constraints
    Voiron, Nicolas
    Benoit, Alexandre
    Filip, Andrei
    Lambert, Patrick
    Ionescu, Bogdan
    [J]. 2015 13TH INTERNATIONAL WORKSHOP ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2015,
  • [8] Consistency regularization for deep semi-supervised clustering with pairwise constraints
    Huang, Dan
    Hu, Jie
    Li, Tianrui
    Du, Shengdong
    Chen, Hongmei
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2022, 13 (11) : 3359 - 3372
  • [9] Semi-supervised classification with pairwise constraints
    Gong, Chen
    Fu, Keren
    Wu, Qiang
    Tu, Enmei
    Yang, Jie
    [J]. NEUROCOMPUTING, 2014, 139 : 130 - 137
  • [10] Semi-supervised deep embedded clustering with pairwise constraints and subset allocation
    Wang, Yalin
    Zou, Jiangfeng
    Wang, Kai
    Liu, Chenliang
    Yuan, Xiaofeng
    [J]. MENDELEEV COMMUNICATIONS, 2023, 164 (01) : 310 - 322