Softly Associative Transfer Learning for Cross-Domain Classification

被引:24
|
作者
Wang, Deqing [1 ]
Lu, Chenwei [1 ]
Wu, Junjie [2 ,3 ,4 ]
Liu, Hongfu [5 ]
Zhang, Wenjie [6 ]
Zhuang, Fuzhen [7 ,8 ]
Zhang, Hui [1 ]
机构
[1] Beihang Univ, Sch Comp Sci, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Econ & Management, Beijing 100191, Peoples R China
[3] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[4] Beihang Univ, Beijing Key Lab Emergency Support Simulat Technol, Beijing 100191, Peoples R China
[5] Brandeis Univ, Sch Comp Sci, Waltham, MA 02453 USA
[6] Yidian News Inc, Ctr Dev & Res, Beijing, Peoples R China
[7] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[8] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Knowledge transfer; Matrix decomposition; Bridges; Optimization; Data models; Feature extraction; Cross-domain text classification; non-negative matrix tri-factorizations (NMTFs); softly associative transfer learning (sa-TL);
D O I
10.1109/TCYB.2019.2891577
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The main challenge of cross-domain text classification is to train a classifier in a source domain while applying it to a different target domain. Many transfer learning-based algorithms, for example, dual transfer learning, triplex transfer learning, etc., have been proposed for cross-domain classification, by detecting a shared low-dimensional feature representation for both source and target domains. These methods, however, often assume that the word clusters matrix or the clusters association matrix as knowledge transferring bridges are exactly the same across different domains, which is actually unrealistic in real-world applications and, therefore, could degrade classification performance. In light of this, in this paper, we propose a softly associative transfer learning algorithm for cross-domain text classification. Specifically, we integrate two non-negative matrix tri-factorizations into a joint optimization framework, with approximate constraints on both word clusters matrices and clusters association matrices so as to allow proper diversity in knowledge transfer, and with another approximate constraint on class labels in source domains in order to handle noisy labels. An iterative algorithm is then proposed to solve the above problem, with its convergence verified theoretically and empirically. Extensive experimental results on various text datasets demonstrate the effectiveness of our algorithm, even with the presence of abundant state-of-the-art competitors.
引用
收藏
页码:4709 / 4721
页数:13
相关论文
共 50 条
  • [41] Cross-domain sentiment classification via topical correspondence transfer
    Zhou, Guangyou
    Zhou, Yin
    Guo, Xiyue
    Tu, Xinhui
    He, Tingting
    [J]. NEUROCOMPUTING, 2015, 159 : 298 - 305
  • [42] Damage detection using in-domain and cross-domain transfer learning
    Zaharah A. Bukhsh
    Nils Jansen
    Aaqib Saeed
    [J]. Neural Computing and Applications, 2021, 33 : 16921 - 16936
  • [43] Damage detection using in-domain and cross-domain transfer learning
    Bukhsh, Zaharah A.
    Jansen, Nils
    Saeed, Aaqib
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (24): : 16921 - 16936
  • [44] Cross-domain sentiment classification based on syntactic structure transfer and domain fusion
    Zhao C.
    Wu M.
    Shen L.
    Shangguan X.
    Wang Y.
    Li J.
    Wang S.
    Li D.
    [J]. Qinghua Daxue Xuebao/Journal of Tsinghua University, 2023, 63 (09): : 1380 - 1389
  • [46] Cross-domain EEG signal classification via geometric preserving transfer discriminative dictionary learning
    Gu, Xiaoqing
    Shen, Zongxuan
    Qu, Jia
    Ni, Tongguang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) : 41733 - 41750
  • [47] Enhanced cross-domain sentiment classification utilizing a multi-source transfer learning approach
    Farhan Hassan Khan
    Usman Qamar
    Saba Bashir
    [J]. Soft Computing, 2019, 23 : 5431 - 5442
  • [48] Cross-domain EEG signal classification via geometric preserving transfer discriminative dictionary learning
    Xiaoqing Gu
    Zongxuan Shen
    Jia Qu
    Tongguang Ni
    [J]. Multimedia Tools and Applications, 2022, 81 : 41733 - 41750
  • [49] Big Cities transfer learning: An unsupervised multi-view cross-domain classification with misses
    Diasse, Abdoullahi
    Li, Zhiyong
    [J]. PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING (ICMLC 2018), 2018, : 312 - 321
  • [50] Enhanced cross-domain sentiment classification utilizing a multi-source transfer learning approach
    Khan, Farhan Hassan
    Qamar, Usman
    Bashir, Saba
    [J]. SOFT COMPUTING, 2019, 23 (14) : 5431 - 5442