Partial Label Learning via GANs With Multiclass SVMs and Information Maximization

被引:4
|
作者
Fan, Jinfu [1 ]
Wang, Zhongjie [1 ]
机构
[1] Tongji Univ, Coll Elect & Informat Engn, Dept Control Sci & Engn, Shanghai 201804, Peoples R China
关键词
Phase locked loops; Generators; Semantics; Supervised learning; Predictive models; Neural networks; Training; Multi-class support vector machines; partial label learning; mutual information; partial contrastive loss;
D O I
10.1109/TCSVT.2022.3192907
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Partial label learning (PLL), an important branch of weakly supervised learning, addresses the problem that each instance is associated with a set of candidate labels and only one is correct. In this paper, a novel adversarial model PL-MIGAN is proposed to simultaneously mitigate two fundamental issues of generative adversarial networks (GANs) in PLL: label disambiguation performance of discriminator and instance synthesis quality of generator. First of all, multi-class support vector machines (SVMs) applied in discriminator to disambiguate the candidate labels and identify fake instances. This strategy not only improves the disadvantage that traditional supervised loss is unable to perform disambiguation but also reduces the influence of cumulative error caused by noise label propagation. Furthermore, a partial contrastive loss is constructed to extend the self-supervised contrastive approach to PLL, allowing us to effectively leverage ambiguous labels information. Finally, the generator jointly employ mutual information (MI) and partial contrastive loss to estimate the latent distribution of each class label. In addition, in order to reduce the impact of ambiguous information, an iteratively optimization procedure is designed to update the label confidence matrix as conditional information guides the generation of instance classes. As adversarial learning proceeds, both the discriminator and the generator alternately and iteratively boost their performance. Simulation results reveal the overwhelming performance of PL-MIGAN.
引用
收藏
页码:8409 / 8421
页数:13
相关论文
共 50 条
  • [1] GraphDPI: Partial label disambiguation by graph representation learning via mutual information maximization
    Fan, Jinfu
    Yu, Yang
    Huang, Linqing
    Wang, Zhongjie
    [J]. PATTERN RECOGNITION, 2023, 134
  • [2] Partial Label Learning by Semantic Difference Maximization
    Feng, Lei
    An, Bo
    [J]. PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 2294 - 2300
  • [3] Understanding Partial Multi-label Learning via Mutual Information
    Gong, Xiuwen
    Yuan, Dong
    Bao, Wei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [4] Partial Label Learning via Label Enhancement
    Xu, Ning
    Lv, Jiaqi
    Geng, Xin
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5557 - 5564
  • [5] Semi-Supervised Partial Label Learning via Confidence-Rated Margin Maximization
    Wang, Wei
    Zhang, Min-Ling
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [6] Partial Label Learning via Label Influence Function
    Gong, Xiuwen
    Yuan, Dong
    Bao, Wei
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [7] Learning human actions via information maximization
    Liu, Jingen
    Shah, Mubarak
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 2971 - 2978
  • [8] Partial label learning with noisy side information
    Shaokai Wang
    Mingxuan Xia
    Zilong Wang
    Gengyu Lyu
    Songhe Feng
    [J]. Applied Intelligence, 2022, 52 : 12382 - 12396
  • [9] Partial label learning with noisy side information
    Wang, Shaokai
    Xia, Mingxuan
    Wang, Zilong
    Lyu, Gengyu
    Feng, Songhe
    [J]. APPLIED INTELLIGENCE, 2022, 52 (11) : 12382 - 12396
  • [10] Partial Label Learning via Gaussian Processes
    Zhou, Yu
    He, Jianjun
    Gu, Hong
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (12) : 4443 - 4450