Transfer Learning Algorithm With Knowledge Division Level

被引:14
|
作者
Han, Honggui [1 ,2 ]
Liu, Hongxu [1 ,2 ]
Yang, Cuili [1 ,2 ]
Qiao, Junfei [1 ,2 ]
机构
[1] Beijing Univ Technol, Beijing Artificial Intelligence Inst, Engn Res Ctr Digital Community,Minist Educ, Fac Informat Technol,Beijing Key Lab Computat Int, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Urban Mass Transit, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 美国国家科学基金会;
关键词
Transfer learning; Task analysis; Learning systems; Knowledge engineering; Prediction algorithms; Measurement; Predictive models; Domain drifting problem; hierarchal transfer learning algorithm; integrated learning method; negative transfer; DOMAIN ADAPTATION; FUZZY SYSTEM; REPRESENTATION; CATEGORIZATION; REGRESSION;
D O I
10.1109/TNNLS.2022.3151646
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the major challenges of transfer learning algorithms is the domain drifting problem where the knowledge of source scene is inappropriate for the task of target scene. To solve this problem, a transfer learning algorithm with knowledge division level (KDTL) is proposed to subdivide knowledge of source scene and leverage them with different drifting degrees. The main properties of KDTL are three folds. First, a comparative evaluation mechanism is developed to detect and subdivide the knowledge into three kinds--the ineffective knowledge, the usable knowledge, and the efficient knowledge. Then, the ineffective and usable knowledge can be found to avoid the negative transfer problem. Second, an integrated framework is designed to prune the ineffective knowledge in the elastic layer, reconstruct the usable knowledge in the refined layer, and learn the efficient knowledge in the leveraged layer. Then, the efficient knowledge can be acquired to improve the learning performance. Third, the theoretical analysis of the proposed KDTL is analyzed in different phases. Then, the convergence property, error bound, and computational complexity of KDTL are provided for the successful applications. Finally, the proposed KDTL is tested by several benchmark problems and some real problems. The experimental results demonstrate that this proposed KDTL can achieve significant improvement over some state-of-the-art algorithms.
引用
收藏
页码:8602 / 8616
页数:15
相关论文
共 50 条
  • [1] Teacher Knowledge and Learning In-situ: A Case Study of the Long Division Algorithm
    Takker, Shikha
    Subramaniam, K.
    AUSTRALIAN JOURNAL OF TEACHER EDUCATION, 2018, 43 (03): : 1 - 20
  • [2] A novel knowledge-leverage-based transfer learning algorithm
    Li, Meiling
    Dai, Qun
    APPLIED INTELLIGENCE, 2018, 48 (08) : 2355 - 2372
  • [3] A novel knowledge-leverage-based transfer learning algorithm
    Meiling Li
    Qun Dai
    Applied Intelligence, 2018, 48 : 2355 - 2372
  • [4] A Two-Level Transfer Learning Algorithm for Evolutionary Multitasking
    Ma, Xiaoliang
    Chen, Qunjian
    Yu, Yanan
    Sun, Yiwen
    Ma, Lijia
    Zhu, Zexuan
    FRONTIERS IN NEUROSCIENCE, 2020, 13
  • [5] Counterfactual inference to predict causal knowledge graph for relational transfer learning by assimilating expert knowledge --Relational feature transfer learning algorithm
    Li, Jiarui
    Horiguchi, Yukio
    Sawaragi, Tetsuo
    ADVANCED ENGINEERING INFORMATICS, 2022, 51
  • [6] An improved reinforcement learning algorithm based on knowledge transfer and applications in autonomous vehicles
    Ding, Derui
    Ding, Zifan
    Wei, Guoliang
    Han, Fei
    NEUROCOMPUTING, 2019, 361 : 243 - 255
  • [7] COVID-19 pneumonia level detection using deep learning algorithm and transfer learning
    Ali, Abbas M.
    Ghafoor, Kayhan
    Mulahuwaish, Aos
    Maghdid, Halgurd
    EVOLUTIONARY INTELLIGENCE, 2024, 17 (02) : 1035 - 1046
  • [8] COVID-19 pneumonia level detection using deep learning algorithm and transfer learning
    Abbas M. Ali
    Kayhan Ghafoor
    Aos Mulahuwaish
    Halgurd Maghdid
    Evolutionary Intelligence, 2024, 17 : 1035 - 1046
  • [9] TRANSFER OF KNOWLEDGE OF MULTIPLICATION FACTS TO THEIR USE IN LONG DIVISION
    Grossnickle, Foster E.
    JOURNAL OF EDUCATIONAL RESEARCH, 1936, 29 (09): : 677 - 685
  • [10] Transfer Learning Based Evolutionary Algorithm for Bi-level Optimization Problems
    Chen, Lei
    Liu, Hai-Lin
    2021 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC 2021), 2021, : 1643 - 1647