Tree-Based Ensemble Multi-Task Learning Method for Classification and Regression

被引:57
|
作者
Simm, Jaak [1 ]
Magrans De Abril, Ildefons [2 ]
Sugiyama, Masashi [3 ]
机构
[1] Tallinn Univ Technol, Fac Sci, EE-19086 Tallinn, Estonia
[2] Vrije Univ Brussel, Artificial Intelligence Lab, Brussels, Belgium
[3] Tokyo Inst Technol, Dept Comp Sci, Tokyo 1528552, Japan
关键词
machine learning; multi-task learning; tree-based methods; ensemble methods;
D O I
10.1587/transinf.E97.D.1677
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-task learning is an important area of machine learning that tries to learn multiple tasks simultaneously to improve the accuracy of each individual task. We propose a new tree-based ensemble multi-task learning method for classification and regression (MT-ExtraTrees), based on Extremely Randomized Trees. MT-ExtraTrees is able to share data between tasks minimizing negative transfer while keeping the ability to learn non-linear solutions and to scale well to large datasets.
引用
收藏
页码:1677 / 1681
页数:5
相关论文
共 50 条
  • [31] Cancer Classification with Multi-task Deep Learning
    Liao, Qing
    Jiang, Lin
    Wang, Xuan
    Zhang, Chunkai
    Ding, Ye
    [J]. 2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 76 - 81
  • [32] paraFaceTest: an ensemble of regression tree-based facial features extraction for efficient facial paralysis classification
    Barbosa, Jocelyn
    Seo, Woo-Keun
    Kang, Jaewoo
    [J]. BMC MEDICAL IMAGING, 2019, 19 (1)
  • [33] Generative Multi-Task Learning for Text Classification
    Zhao, Wei
    Gao, Hui
    Chen, Shuhui
    Wang, Nan
    [J]. IEEE ACCESS, 2020, 8 : 86380 - 86387
  • [34] Inductive learning of tree-based regression models
    Torgo, L
    [J]. AI COMMUNICATIONS, 2000, 13 (02) : 137 - 138
  • [35] Multi-label emotion classification based on adversarial multi-task learning
    Lin, Nankai
    Fu, Sihui
    Lin, Xiaotian
    Wang, Lianxi
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (06)
  • [36] Joint Classification and Trajectory Regression of Online Handwriting using a Multi-Task Learning Approach
    Ott, Felix
    Ruegamer, David
    Heublein, Lucas
    Bischl, Bernd
    Mutschler, Christopher
    [J]. 2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1244 - 1254
  • [37] Ensemble Compressed Language Model Based on Knowledge Distillation and Multi-Task Learning
    Xiang, Kun
    Fujii, Akihiro
    [J]. 2022 7TH INTERNATIONAL CONFERENCE ON BUSINESS AND INDUSTRIAL RESEARCH (ICBIR2022), 2022, : 72 - 77
  • [38] Multi-task learning regression via convex clustering
    Okazaki, Akira
    Kawano, Shuichi
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2024, 195
  • [39] Logistic Regression Based Multi-task, Multi-kernel Learning for Emotion Recognition
    He, Xinrun
    Huang, Jian
    Zeng, Zhigang
    [J]. 2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 572 - 577
  • [40] Multi-Task Learning-Based Immunofluorescence Classification of Kidney Disease
    Pan, Sai
    Fu, Yibing
    Chen, Pu
    Liu, Jiaona
    Liu, Weicen
    Wang, Xiaofei
    Cai, Guangyan
    Yin, Zhong
    Wu, Jie
    Tang, Li
    Wang, Yong
    Duan, Shuwei
    Dai, Ning
    Jiang, Lai
    Xu, Mai
    Chen, Xiangmei
    [J]. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (20)