Softly Associative Transfer Learning for Cross-Domain Classification

被引:24
|
作者
Wang, Deqing [1 ]
Lu, Chenwei [1 ]
Wu, Junjie [2 ,3 ,4 ]
Liu, Hongfu [5 ]
Zhang, Wenjie [6 ]
Zhuang, Fuzhen [7 ,8 ]
Zhang, Hui [1 ]
机构
[1] Beihang Univ, Sch Comp Sci, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Econ & Management, Beijing 100191, Peoples R China
[3] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[4] Beihang Univ, Beijing Key Lab Emergency Support Simulat Technol, Beijing 100191, Peoples R China
[5] Brandeis Univ, Sch Comp Sci, Waltham, MA 02453 USA
[6] Yidian News Inc, Ctr Dev & Res, Beijing, Peoples R China
[7] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
[8] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Knowledge transfer; Matrix decomposition; Bridges; Optimization; Data models; Feature extraction; Cross-domain text classification; non-negative matrix tri-factorizations (NMTFs); softly associative transfer learning (sa-TL);
D O I
10.1109/TCYB.2019.2891577
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The main challenge of cross-domain text classification is to train a classifier in a source domain while applying it to a different target domain. Many transfer learning-based algorithms, for example, dual transfer learning, triplex transfer learning, etc., have been proposed for cross-domain classification, by detecting a shared low-dimensional feature representation for both source and target domains. These methods, however, often assume that the word clusters matrix or the clusters association matrix as knowledge transferring bridges are exactly the same across different domains, which is actually unrealistic in real-world applications and, therefore, could degrade classification performance. In light of this, in this paper, we propose a softly associative transfer learning algorithm for cross-domain text classification. Specifically, we integrate two non-negative matrix tri-factorizations into a joint optimization framework, with approximate constraints on both word clusters matrices and clusters association matrices so as to allow proper diversity in knowledge transfer, and with another approximate constraint on class labels in source domains in order to handle noisy labels. An iterative algorithm is then proposed to solve the above problem, with its convergence verified theoretically and empirically. Extensive experimental results on various text datasets demonstrate the effectiveness of our algorithm, even with the presence of abundant state-of-the-art competitors.
引用
收藏
页码:4709 / 4721
页数:13
相关论文
共 50 条
  • [31] Ontology-Driven Cross-Domain Transfer Learning
    Fumagalli, Mattia
    Bella, Gabor
    Conti, Samuele
    Giunchiglia, Fausto
    [J]. FORMAL ONTOLOGY IN INFORMATION SYSTEMS, FOIS 2020, 2020, 330 : 249 - 263
  • [32] Cross-Domain Latent Modulation for Variational Transfer Learning
    Hou, Jinyong
    Deng, Jeremiah D.
    Cranefield, Stephen
    Ding, Xuejie
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3148 - 3157
  • [33] A transfer learning approach to cross-domain authorship attribution
    Barlas, Georgios
    Stamatatos, Efstathios
    [J]. EVOLVING SYSTEMS, 2021, 12 (03) : 625 - 643
  • [34] A Collaborative Transfer Learning Framework for Cross-domain Recommendation
    Zhang, Wei
    Zhang, Pengye
    Zhang, Bo
    Wang, Xingxing
    Wang, Dong
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 5576 - 5585
  • [35] Cross-domain activity recognition via transfer learning
    Hu, Derek Hao
    Zheng, Vincent Wenchen
    Yang, Qiang
    [J]. PERVASIVE AND MOBILE COMPUTING, 2011, 7 (03) : 344 - 358
  • [36] Hierarchical Attention Transfer Network for Cross-Domain Sentiment Classification
    Li, Zheng
    Wei, Ying
    Zhang, Yu
    Yang, Qiang
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 5852 - 5859
  • [37] Wasserstein based transfer network for cross-domain sentiment classification
    Du, Yongping
    He, Meng
    Wang, Lulin
    Zhang, Haitong
    [J]. KNOWLEDGE-BASED SYSTEMS, 2020, 204
  • [38] Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification
    Zhang, Kai
    Liu, Qi
    Huang, Zhenya
    Cheng, Mingyue
    Zhang, Kun
    Zhang, Mengdi
    Wu, Wei
    Chen, Enhong
    [J]. PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 1566 - 1576
  • [39] Cross-domain sentiment classification via topical correspondence transfer
    Zhou, Guangyou
    Zhou, Yin
    Guo, Xiyue
    Tu, Xinhui
    He, Tingting
    [J]. NEUROCOMPUTING, 2015, 159 : 298 - 305
  • [40] Interactive Attention Transfer Network for Cross-Domain Sentiment Classification
    Zhang, Kai
    Zhang, Hefu
    Liu, Qi
    Zhao, Hongke
    Zhu, Hengshu
    Chen, Enhong
    [J]. THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5773 - 5780