Tree-Based Ensemble Multi-Task Learning Method for Classification and Regression

被引:57
|
作者
Simm, Jaak [1 ]
Magrans De Abril, Ildefons [2 ]
Sugiyama, Masashi [3 ]
机构
[1] Tallinn Univ Technol, Fac Sci, EE-19086 Tallinn, Estonia
[2] Vrije Univ Brussel, Artificial Intelligence Lab, Brussels, Belgium
[3] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
关键词
machine learning; multi-task learning; tree-based methods; ensemble methods;
D O I
10.1587/transinf.E97.D.1677
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-task learning is an important area of machine learning that tries to learn multiple tasks simultaneously to improve the accuracy of each individual task. We propose a new tree-based ensemble multi-task learning method for classification and regression (MT-ExtraTrees), based on Extremely Randomized Trees. MT-ExtraTrees is able to share data between tasks minimizing negative transfer while keeping the ability to learn non-linear solutions and to scale well to large datasets.
引用
收藏
页码:1677 / 1681
页数:5
相关论文
共 50 条
  • [1] A Regression Model Tree Algorithm by Multi-task Learning
    Jo, Seeun
    Jun, Chi-Hyuck
    [J]. INDUSTRIAL ENGINEERING AND MANAGEMENT SYSTEMS, 2021, 20 (02): : 163 - 171
  • [2] Collaborative Self-Regression Method With Nonlinear Feature Based on Multi-Task Learning for Image Classification
    Li, Ao
    Wu, Zhiqiang
    Lu, Huaiyin
    Chen, Deyun
    Sun, Guanglu
    [J]. IEEE ACCESS, 2018, 6 : 43513 - 43525
  • [3] Multi-task Sparse Regression Metric Learning for Heterogeneous Classification
    Wu, Haotian
    Zhou, Bin
    Zhu, Pengfei
    Hu, Qinghua
    Shi, Hong
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: DEEP LEARNING, PT II, 2019, 11728 : 543 - 553
  • [4] Ensemble Learning Based on Multi-Task Class Labels
    Wang, Qing
    Zhang, Liang
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT II, PROCEEDINGS, 2010, 6119 : 464 - 475
  • [5] Multi-Task Active Learning for Simultaneous Emotion Classification and Regression
    Jiang, Xue
    Meng, Lubin
    Wu, Dongrui
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1947 - 1952
  • [6] Comparison of tree-based ensemble models for regression
    Park, Sangho
    Kim, Chanmin
    [J]. COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2022, 29 (05) : 561 - 590
  • [7] Tree-based classification and regression Part 3: Tree-based procedures
    Gunter, B
    [J]. QUALITY PROGRESS, 1998, 31 (02) : 121 - 123
  • [8] Learning Tree Structure in Multi-Task Learning
    Han, Lei
    Zhang, Yu
    [J]. KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, : 397 - 406
  • [9] MTForest: Ensemble Decision Trees based on Multi-Task Learning
    Wang, Qing
    Zhang, Liang
    Chi, Mingmin
    Guo, Jiankui
    [J]. ECAI 2008, PROCEEDINGS, 2008, 178 : 122 - +
  • [10] Application of decision tree-based ensemble learning in the classification of breast cancer
    Ghiasi, Mohammad M.
    Zendehboudi, Sohrab
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2021, 128