l1-norm based safe semi-supervised learning

被引:0
|
作者
Gan, Haitao [1 ,2 ]
Yang, Zhi [1 ,3 ]
Wang, Ji [1 ]
Li, Bing [4 ]
机构
[1] Hubei Univ Technol, Sch Comp Sci, Wuhan 430068, Peoples R China
[2] Key Lab Brain Machine Collaborat Intelligence Zhe, Hangzhou 310018, Peoples R China
[3] State Key Lab Biocatalysis & Enzyme Engn, Wuhan 430062, Peoples R China
[4] Wuhan Inst Shipbldg Technol, Sch Traff & Transportat Engn, Wuhan 430050, Peoples R China
基金
中国国家自然科学基金;
关键词
semi-supervised learning; safe semi-supervised learning; performance degradation; l(1) norm; importance estimation;
D O I
10.3934/mbe.2021383
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the past few years, Safe Semi-Supervised Learning (S3L) has received considerable attentions in machine learning field. Different researchers have proposed many S3L methods for safe exploitation of risky unlabeled samples which result in performance degradation of Semi-Supervised Learning (SSL). Nevertheless, there exist some shortcomings: (1) Risk degrees of the unlabeled samples are in advance defined by analyzing prediction differences between Supervised Learning (SL) and SSL; (2) Negative impacts of labeled samples on learning performance are not investigated. Therefore, it is essential to design a novel method to adaptively estimate importance and risk of both unlabeled and labeled samples. For this purpose, we present l(1)-norm based S3L which can simultaneously reach the safe exploitation of the labeled and unlabeled samples in this paper. In order to solve the proposed ptimization problem, we utilize an effective iterative approach. In each iteration, one can adaptively estimate the weights of both labeled and unlabeled samples. The weights can reflect the importance or risk of the labeled and unlabeled samples. Hence, the negative effects of the labeled and unlabeled samples are expected to be reduced. Experimental performance on different datasets verifies that the proposed S3L method can obtain comparable performance with the existing SL, SSL and S3L methods and achieve the expected goal.
引用
收藏
页码:7727 / 7742
页数:16
相关论文
共 50 条
  • [1] Unsupervised and Semi-Supervised Learning via l1-Norm Graph
    Nie, Feiping
    Wang, Hua
    Huang, Heng
    Ding, Chris
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 2268 - 2273
  • [2] L1-norm Laplacian support vector machine for data reduction in semi-supervised learning
    Xiaohan Zheng
    Li Zhang
    Zhiqiang Xu
    [J]. Neural Computing and Applications, 2023, 35 : 12343 - 12360
  • [3] L1-norm Laplacian support vector machine for data reduction in semi-supervised learning
    Zheng, Xiaohan
    Zhang, Li
    Xu, Zhiqiang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (17): : 12343 - 12360
  • [4] L1-Norm Driven Semi-Supervised Local Discriminant Projection for Robust Image Representation
    Wang, Xiaoyu
    Zhang, Zhao
    Tang, Yu
    Jiang, Weiming
    Li, Fanzhang
    [J]. 2015 IEEE 27TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2015), 2015, : 391 - 397
  • [5] Dual Learning-Based Safe Semi-Supervised Learning
    Gan, Haitao
    Li, Zhenhua
    Fan, Yingle
    Luo, Zhizeng
    [J]. IEEE ACCESS, 2018, 6 : 2615 - 2621
  • [6] Safe semi-supervised learning based on weighted likelihood
    Kawakita, Masanori
    Takeuchi, Jun'ichi
    [J]. NEURAL NETWORKS, 2014, 53 : 146 - 164
  • [7] Semi-supervised learning with nuclear norm regularization
    Shang, Fanhua
    Jiao, L. C.
    Liu, Yuanyuan
    Tong, Hanghang
    [J]. PATTERN RECOGNITION, 2013, 46 (08) : 2323 - 2336
  • [8] Learning Safe Prediction for Semi-Supervised Regression
    Li, Yu-Feng
    Zha, Han-Wen
    Zhou, Zhi-Hua
    [J]. THIRTY-FIRST AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2217 - 2223
  • [9] Safe semi-supervised learning: a brief introduction
    Li, Yu-Feng
    Liang, De-Ming
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2019, 13 (04) : 669 - 676
  • [10] A hybrid safe semi-supervised learning method
    Gan, Haitao
    Guo, Li
    Xia, Siyu
    Wang, Tao
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 149