Task Selection and Resource Optimization in Multi-Task Federated Learning With Model Decomposition

被引:0
|
作者
Sun, Haowen [1 ]
Chen, Ming [1 ,2 ]
Yang, Zhaohui [3 ]
Pan, Yijin [1 ]
Cang, Yihan [1 ]
Zhang, Zhaoyang [3 ]
机构
[1] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[2] Purple Mt Labs, Nanjing 211100, Peoples R China
[3] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Convergence; Data models; Uplink; Vectors; Training; Federated learning; Bandwidth; Resource management; Radio frequency; Distributed databases; Multi-task federated learning; resource allocation; non-IID data;
D O I
10.1109/LCOMM.2024.3511663
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In this letter, we investigate the training latency minimization problem for a multi-task federated learning (FL) framework with model decomposition over wireless communication networks. To handle the non-independent and non-identically distributed (non-IID) data, we first transform the multi-class classification task into multiple binary classification tasks. We then introduce sampling equalization to ensure the convergence of FL system. The optimization problem aims to minimize the training latency under energy and FL convergence constraints by optimizing task selection, number of learning iterations, and communication resource allocation. We decompose it into three sub-problems and propose alternating algorithm to address each sub-problem iteratively. Numerical results validate that the proposed algorithm significantly reduces time consumption compared to the conventional algorithms.
引用
收藏
页码:225 / 229
页数:5
相关论文
共 50 条
  • [41] Task Switching Network for Multi-task Learning
    Sun, Guolei
    Probst, Thomas
    Paudel, Danda Pani
    Popovic, Nikola
    Kanakis, Menelaos
    Patel, Jagruti
    Dai, Dengxin
    Van Gool, Luc
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 8271 - 8280
  • [42] Model-Protected Multi-Task Learning
    Liang, Jian
    Liu, Ziqi
    Zhou, Jiayu
    Jiang, Xiaoqian
    Zhang, Changshui
    Wang, Fei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 1002 - 1019
  • [43] Multi-Task Clustering with Model Relation Learning
    Zhang, Xiaotong
    Zhang, Xianchao
    Liu, Han
    Luo, Jiebo
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 3132 - 3140
  • [44] Multi-Task Model and Feature Joint Learning
    Li, Ya
    Tian, Xinmei
    Liu, Tongliang
    Tao, Dacheng
    PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), 2015, : 3643 - 3649
  • [45] Federated Multi-Task Learning with Non-Stationary Heterogeneous Data
    Zhang, Hongwei
    Tao, Meixia
    Shi, Yuanming
    Bi, Xiaoyan
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 4950 - 4955
  • [46] Federated Multi-task Learning with Hierarchical Attention for Sensor Data Analytics
    Chen, Yujing
    Ning, Yue
    Chai, Zheng
    Rangwala, Huzefa
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [47] PFedSA: Personalized Federated Multi-Task Learning via Similarity Awareness
    Ye, Chuyao
    Zheng, Hao
    Hu, Zhigang
    Zheng, Meiguang
    2023 IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, IPDPS, 2023, : 480 - 488
  • [48] A Personalized Federated Multi-task Learning Scheme for Encrypted Traffic Classification
    Guan, Xueyu
    Du, Run
    Wang, Xiaohan
    Qu, Haipeng
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 258 - 270
  • [49] Multi-task Federated Learning Medical Analysis Algorithm Integrated Into Adapter
    Zhao, Yuyuan
    Zhao, Tian
    Xiang, Peng
    Li, Qingshan
    Chen, Zhong
    2023 IEEE 8TH INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS, ICBDA, 2023, : 24 - 30
  • [50] Effective 3C Resource Utilization and Fair Allocation Strategy for Multi-Task Federated Learning
    Zhang, Chaofeng
    Dong, Mianxiong
    Ota, Kaoru
    IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1 : 153 - 167