Unsupervised image clustering algorithm based on contrastive learning and K-nearest neighbors

被引:8
|
作者
Zhang, Xiuling [1 ,2 ]
Wang, Shuo [1 ]
Wu, Ziyun [1 ]
Tan, Xiaofei [1 ]
机构
[1] Yanshan Univ, Engn Res Ctr, Minist Educ Intelligent Control Syst & Intelligen, Qinhuangdao 066004, Hebei, Peoples R China
[2] Yanshan Univ, Key Lab Ind Comp Control Engn Hebei Prov, Qinhuangdao 066004, Hebei, Peoples R China
关键词
Contrastive learning; K-nearest neighbors; Double data augmentation; Double contrastive loss;
D O I
10.1007/s13042-022-01533-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the development of the times, people generate a huge amount of data every day, most of which are unlabeled data, but manual labeling needs a lot of time and effort, so unsupervised algorithms are being used more often. This paper proposes an unsupervised image clustering algorithm based on contrastive learning and K-nearest neighbors (CLKNN). CLKNN is trained in two steps, which are the representation learning step and the clustering step. Contrastive learning and K-nearest neighbors have a huge impact on CLKNN. In the representation learning step, firstly CLKNN processes the image by double data augmentation to get two different augmented images; then CLKNN uses double contrastive loss to extract the high-level feature information of the augmented images, maximizing the similarity of row space and maximizing the similarity of column space to ensure the invariance of information. In the clustering step, CLKNN finds the nearest neighbors of each image by K-nearest neighbors, then it maximizes the similarity between each image and its nearest neighbors to get the final result. To test the performance of CLKNN, the experiments are conducted on CIFAR-10, CIFAR-100 and STL-10 in this paper. From the final results, it is clear that CLKNN has better performance than other advanced algorithms.
引用
收藏
页码:2415 / 2423
页数:9
相关论文
共 50 条
  • [1] Unsupervised image clustering algorithm based on contrastive learning and K-nearest neighbors
    Xiuling Zhang
    Shuo Wang
    Ziyun Wu
    Xiaofei Tan
    [J]. International Journal of Machine Learning and Cybernetics, 2022, 13 : 2415 - 2423
  • [2] K-nearest neighbors clustering algorithm
    Gauza, Dariusz
    Zukowska, Anna
    Nowak, Robert
    [J]. PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2014, 2014, 9290
  • [3] Relative density based K-nearest neighbors clustering algorithm
    Liu, QB
    Deng, S
    Lu, CH
    Wang, B
    Zhou, YF
    [J]. 2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS, 2003, : 133 - 137
  • [4] An efficient clustering algorithm based on the k-nearest neighbors with an indexing ratio
    Raneem Qaddoura
    Hossam Faris
    Ibrahim Aljarah
    [J]. International Journal of Machine Learning and Cybernetics, 2020, 11 : 675 - 714
  • [5] An efficient clustering algorithm based on the k-nearest neighbors with an indexing ratio
    Qaddoura, Raneem
    Faris, Hossam
    Aljarah, Ibrahim
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2020, 11 (03) : 675 - 714
  • [6] A UNIMODAL CLUSTERING-ALGORITHM BASED ON THE K-NEAREST NEIGHBORS METHOD
    KOVALENKO, AP
    [J]. AUTOMATION AND REMOTE CONTROL, 1993, 54 (05) : 794 - 798
  • [7] TWO-PHASES CLUSTERING ALGORITHM BASED ON SUBTRACTIVE CLUSTERING AND K-NEAREST NEIGHBORS
    Shieh, Horng-Lin
    Kuo, Cheng-Chien
    Chen, Fu-Hsien
    [J]. PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 1802 - 1806
  • [8] Density Peaks Clustering Algorithm Based on Representative Points and K-nearest Neighbors
    Zhang Q.-H.
    Zhou J.-P.
    Dai Y.-Y.
    Wang G.-Y.
    [J]. Ruan Jian Xue Bao/Journal of Software, 2023, 34 (12): : 5629 - 5648
  • [9] An Adaptable k-Nearest Neighbors Algorithm for MMSE Image Interpolation
    Ni, Karl S.
    Nguyen, Truong Q.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (09) : 1976 - 1987
  • [10] Chameleon algorithm based on mutual k-nearest neighbors
    Yuru Zhang
    Shifei Ding
    Lijuan Wang
    Yanru Wang
    Ling Ding
    [J]. Applied Intelligence, 2021, 51 : 2031 - 2044