Transfer Learning Algorithm With Knowledge Division Level

被引:14
|
作者
Han, Honggui [1 ,2 ]
Liu, Hongxu [1 ,2 ]
Yang, Cuili [1 ,2 ]
Qiao, Junfei [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Engn Res Ctr Digital Community,Minist Educ, Fac Informat Technol,Beijing Key Lab Computat Int, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Urban Mass Transit, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
Transfer learning; Task analysis; Learning systems; Knowledge engineering; Prediction algorithms; Measurement; Predictive models; Domain drifting problem; hierarchal transfer learning algorithm; integrated learning method; negative transfer; DOMAIN ADAPTATION; FUZZY SYSTEM; REPRESENTATION; CATEGORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2022.3151646
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the major challenges of transfer learning algorithms is the domain drifting problem where the knowledge of source scene is inappropriate for the task of target scene. To solve this problem, a transfer learning algorithm with knowledge division level (KDTL) is proposed to subdivide knowledge of source scene and leverage them with different drifting degrees. The main properties of KDTL are three folds. First, a comparative evaluation mechanism is developed to detect and subdivide the knowledge into three kinds--the ineffective knowledge, the usable knowledge, and the efficient knowledge. Then, the ineffective and usable knowledge can be found to avoid the negative transfer problem. Second, an integrated framework is designed to prune the ineffective knowledge in the elastic layer, reconstruct the usable knowledge in the refined layer, and learn the efficient knowledge in the leveraged layer. Then, the efficient knowledge can be acquired to improve the learning performance. Third, the theoretical analysis of the proposed KDTL is analyzed in different phases. Then, the convergence property, error bound, and computational complexity of KDTL are provided for the successful applications. Finally, the proposed KDTL is tested by several benchmark problems and some real problems. The experimental results demonstrate that this proposed KDTL can achieve significant improvement over some state-of-the-art algorithms.
引用
收藏
页码:8602 / 8616
页数:15
相关论文
共 50 条
  • [41] Active Selection Transfer Learning Algorithm
    Wu, Weifei
    Zhang, Yanhui
    Xing, Fuyijin
    NEURAL PROCESSING LETTERS, 2023, 55 (07) : 10093 - 10116
  • [42] Heterogeneous transductive transfer learning algorithm
    Beijing Key Laboratory of Traffic Data Analysis and Mining , Beijing
    100044, China
    不详
    071000, China
    不详
    071000, China
    Ruan Jian Xue Bao, 11 (2762-2780):
  • [43] A MultiBoosting Based Transfer Learning Algorithm
    Liu, Xiaobo
    Wang, Guangjun
    Cai, Zhihua
    Zhang, Harry
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2015, 19 (03) : 381 - 388
  • [44] An Algorithm for Transfer Learning in a Heterogeneous Environment
    Argyriou, Andreas
    Maurer, Andreas
    Pontil, Massimiliano
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PART I, PROCEEDINGS, 2008, 5211 : 71 - +
  • [45] Online Transfer Learning: Negative Transfer and Effect of Prior Knowledge
    Wu, Xuetong
    Manton, Jonathan H.
    Aickelin, Uwe
    Zhu, Jingge
    2021 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2021, : 1540 - 1545
  • [46] Category-Level Transfer Learning from Knowledge Base to Microblog Stream for Accurate Event Detection
    Huang, Weijing
    Wang, Tengjiao
    Chen, Wei
    Wang, Yazhou
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2017), PT I, 2017, 10177 : 50 - 67
  • [47] An Adaptive Learning System based on Knowledge Level for English Learning
    Sfenrianto, Sfenrianto
    Hartarto, Yustinus B.
    Akbar, Habibullah
    Mukhtar, Mukhneri
    Efriadi, Efriadi
    Wahyudi, Mochamad
    INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2018, 13 (12): : 191 - 200
  • [48] Learning to Predict Consequences as a Method of Knowledge Transfer in Reinforcement Learning
    Chalmers, Eric
    Contreras, Edgar Bermudez
    Robertson, Brandon
    Luczak, Artur
    Gruber, Aaron
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) : 2259 - 2270
  • [49] Federated Learning Algorithm Based on Knowledge Distillation
    Jiang, Donglin
    Shan, Chen
    Zhang, Zhihui
    2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER ENGINEERING (ICAICE 2020), 2020, : 163 - 167
  • [50] Quantum Machine Learning Algorithm for Knowledge Graphs
    Ma, Yunpu
    Tresp, Volker
    ACM TRANSACTIONS ON QUANTUM COMPUTING, 2021, 2 (03):