A New Semi-Supervised Inductive Transfer Learning Framework: Co-Transfer

被引:0
|
作者
Wen Y. [1 ,2 ]
Yuan Z. [1 ]
Yu H. [3 ]
机构
[1] School of Computer Science and Information Safety, Guilin University of Electronic Technology, Guangxi, Guilin
[2] Guangxi Key Laboratory of Image and Graphic Intelligent Processing, Guilin University of Electronic Technology, Guangxi, Guilin
[3] School of Computer Engineering and Science, Shanghai University, Shanghai
基金
中国国家自然科学基金;
关键词
bi-directional transfer; ensemble learning; multi-task learning; semi-supervised learning; transfer learning;
D O I
10.7544/issn1000-1239.202220232
中图分类号
学科分类号
摘要
In many practical data mining scenarios, such as network intrusion detection, Twitter spam detection, and computer-aided diagnosis, source domain that is different but related to a target domain is very common. Generally, a large amount of unlabeled data is available in both source domain and target domain, but labeling each of them is difficult, expensive, time-consuming, and sometime unnecessary. Therefore, it is very important and worthwhile to fully explore the labeled and unlabeled data in source domain and target domain to handle classification tasks in target domain. To leverage transfer learning and semi-supervised learning, we propose a new inductive transfer learning framework named Co-Transfer. Co-Transfer first generates three TrAdaBoost classifiers for transfer learning from the original source domain to the original target domain, and meanwhile another three TrAdaBoost classifiers are generated for transfer learning from the original target domain to the original source domain by bootstrapping samples from the original labeled data. In each round of Co-Transfer, each group of TrAdaBoost classifiers is refined by using the carefully labeled data, one part of which is the original labeled samples, the second part is the samples labeled by one group of TrAdaBoost classifiers, and the other samples are labeled by another group of TrAdaBoost classifiers. Finally, the group of TrAdaBoost classifiers learned to transfer from the original source domain to the original target domain to produce the final hypothesis. Experimental results on UCI and text classification task datasets illustrate that Co-Transfer can significantly improve generalization performance by exploring labeled and unlabeled data across different tasks. © 2023 Science Press. All rights reserved.
引用
收藏
页码:1603 / 1614
页数:11
相关论文
共 29 条
  • [1] Pan S, Qiang Yang, A survey on transfer learning[J], IEEE Transactions on Knowledge and Data Engineering, 22, 10, pp. 1345-1359, (2010)
  • [2] Fuzhen Zhuang, Zhiyuan Qi, Keyu Duan, Et al., A comprehensive survey on transfer learning[J], Proceedings of the IEEE, 109, 1, pp. 43-76, (2020)
  • [3] Liu Xiaobo, Zhang H, Cai Zhihua, Et al., A Tri-training based transfer learning algorithm[C], Proc of the 24th Int Conf on Tools with Artificial Intelligence, pp. 698-703, (2012)
  • [4] Tang Yejun, Wu Bin, Peng Liangrui, Et al., Semi-supervised transfer learning for convolution neural network based Chinese character recognition[C], Proc of the 14th IAPR Int Conf on Document Analysis and Recognition (ICDAR), pp. 441-447, (2017)
  • [5] Abuduweili A, Li Xingjian, Shi H, Et al., Adaptive consistency regularization for semi-supervised transfer learning, Proc of the 34th IEEE/CVF Conf on Computer Vision and Pattern Recognition, pp. 6923-6932, (2021)
  • [6] Wei Wei, Meng Deyu, Zhao Qian, Et al., Semi-supervised transfer learning for image rain removal, Proc of the 32nd IEEE/CVF Conf on Computer Vision and Pattern Recognition, pp. 3877-3886, (2019)
  • [7] Chebli A, Djebbar A, Marouani H., Semi-supervised learning for medical application: A survey[C], Proc of the 9th Int Conf on Applied Smart Systems (ICASS), pp. 1-9, (2018)
  • [8] Mohanasundaram R, Malhotra A, Arun R, Et al., Deep Learning and Semi-supervised and Transfer Learning Algorithms for Medical Imaging[M], Deep Learning and Parallel Computing Environment for Bioengineering Systems, pp. 139-151, (2019)
  • [9] Quande Liu, Lequan Yu, Luyang Luo, Et al., Semi-supervised medical image classification with relation-driven self-ensembling model[J], IEEE Transactions on Medical Imaging, 39, 11, pp. 3429-3440, (2020)
  • [10] Qinhua Liu, Xuejun Liao, Hui Li, Et al., Semi-supervised multitask learning[J], IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 6, pp. 1074-1086, (2008)