Softly Associative Transfer Learning for Cross-Domain Classification

被引:24
|
作者
Wang, Deqing [1 ]
Lu, Chenwei [1 ]
Wu, Junjie [2 ,3 ,4 ]
Liu, Hongfu [5 ]
Zhang, Wenjie [6 ]
Zhuang, Fuzhen [7 ,8 ]
Zhang, Hui [1 ]
机构
[1] Beihang Univ, Sch Comp Sci, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Econ & Management, Beijing 100191, Peoples R China
[3] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[4] Beihang Univ, Beijing Key Lab Emergency Support Simulat Technol, Beijing 100191, Peoples R China
[5] Brandeis Univ, Sch Comp Sci, Waltham, MA 02453 USA
[6] Yidian News Inc, Ctr Dev & Res, Beijing, Peoples R China
[7] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[8] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Knowledge transfer; Matrix decomposition; Bridges; Optimization; Data models; Feature extraction; Cross-domain text classification; non-negative matrix tri-factorizations (NMTFs); softly associative transfer learning (sa-TL);
D O I
10.1109/TCYB.2019.2891577
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The main challenge of cross-domain text classification is to train a classifier in a source domain while applying it to a different target domain. Many transfer learning-based algorithms, for example, dual transfer learning, triplex transfer learning, etc., have been proposed for cross-domain classification, by detecting a shared low-dimensional feature representation for both source and target domains. These methods, however, often assume that the word clusters matrix or the clusters association matrix as knowledge transferring bridges are exactly the same across different domains, which is actually unrealistic in real-world applications and, therefore, could degrade classification performance. In light of this, in this paper, we propose a softly associative transfer learning algorithm for cross-domain text classification. Specifically, we integrate two non-negative matrix tri-factorizations into a joint optimization framework, with approximate constraints on both word clusters matrices and clusters association matrices so as to allow proper diversity in knowledge transfer, and with another approximate constraint on class labels in source domains in order to handle noisy labels. An iterative algorithm is then proposed to solve the above problem, with its convergence verified theoretically and empirically. Extensive experimental results on various text datasets demonstrate the effectiveness of our algorithm, even with the presence of abundant state-of-the-art competitors.
引用
收藏
页码:4709 / 4721
页数:13
相关论文
共 50 条
  • [1] Dyadic Transfer Learning for Cross-Domain Image Classification
    Wang, Hua
    Nie, Feiping
    Huang, Heng
    Ding, Chris
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2011, : 551 - 556
  • [2] Cross-Domain Sentiment Classification Based on Representation Learning and Transfer Learning
    Liao, Xiangwen
    Wu, Xiaojing
    Gui, Lin
    Huang, Jinhui
    Chen, Guolong
    [J]. Beijing Daxue Xuebao (Ziran Kexue Ban)/Acta Scientiarum Naturalium Universitatis Pekinensis, 2019, 55 (01): : 37 - 46
  • [3] Deep Transfer Learning for Biology Cross-Domain Image Classification
    Guo, Chunfeng
    Wei, Bin
    Yu, Kun
    [J]. JOURNAL OF CONTROL SCIENCE AND ENGINEERING, 2021, 2021
  • [4] A Transfer Learning Analysis of Political Leaning Classification in Cross-domain Content
    Caled, Danielle
    Silva, Mario J.
    [J]. COMPUTATIONAL PROCESSING OF THE PORTUGUESE LANGUAGE, PROPOR 2022, 2022, 13208 : 267 - 277
  • [5] Deep Transfer Learning for Social Media Cross-Domain Sentiment Classification
    Zhao, Chuanjun
    Wang, Suge
    Li, Deyu
    [J]. SOCIAL MEDIA PROCESSING, SMP 2017, 2017, 774 : 232 - 243
  • [6] Progressive Transfer Learning and Adversarial Domain Adaptation for Cross-Domain Skin Disease Classification
    Gu, Yanyang
    Ge, Zongyuan
    Bonnington, C. Paul
    Zhou, Jun
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (05) : 1379 - 1393
  • [7] A Coherent Cooperative Learning Framework Based on Transfer Learning for Unsupervised Cross-Domain Classification
    Shan, Xinxin
    Wen, Ying
    Li, Qingli
    Lu, Yue
    Cai, Haibin
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT V, 2021, 12905 : 96 - 106
  • [8] Representation Learning for Imbalanced Cross-Domain Classification
    Cheng, Lu
    Guo, Ruocheng
    Candan, K. Selcuk
    Liu, Huan
    [J]. PROCEEDINGS OF THE 2020 SIAM INTERNATIONAL CONFERENCE ON DATA MINING (SDM), 2020, : 478 - 486
  • [9] Cross-Domain Automatic Modulation Classification Using Multimodal Information and Transfer Learning
    Deng, Wen
    Xu, Qiang
    Li, Si
    Wang, Xiang
    Huang, Zhitao
    [J]. REMOTE SENSING, 2023, 15 (15)
  • [10] Cross-domain text classification algorithm based on instance-transfer learning
    Liu, Ruijun
    Wang, Jun
    Yu, Zhuo
    Shi, Yuqian
    Zhang, Lun
    Ji, Changjiang
    Jin, Xin
    [J]. INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND ROBOTICS 2020, 2020, 11574